-- Logs begin at Wed 2022-08-31 03:54:15 UTC, end at Wed 2022-08-31 04:53:30 UTC. -- Aug 31 04:26:21.164778 dv-cinder-855307-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 04:26:21.173596 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 04:26:21 2022] *** Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: nodename: dv-cinder-855307-1-iscsi Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: machine: x86_64 Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: clock source: unix Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: pcre jit disabled Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: detected number of CPU cores: 4 Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: current working directory: / Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: detected binary path: /usr/bin/uwsgi-core Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: your processes number limit is 47680 Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: your memory page size is 4096 bytes Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: detected max file descriptor number: 2048 Aug 31 04:26:21.175652 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: lock engine: pthread robust mutexes Aug 31 04:26:21.176644 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: thunder lock: enabled Aug 31 04:26:21.176644 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 04:26:21.176644 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 04:26:21.214745 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: Python main interpreter initialized at 0x55f2ac2019c0 Aug 31 04:26:21.214745 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: python threads support enabled Aug 31 04:26:21.214745 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: your server socket listen backlog is limited to 100 connections Aug 31 04:26:21.214745 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: your mercy for graceful operations on workers is 90 seconds Aug 31 04:26:21.215081 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 04:26:21.215154 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: *** Operational MODE: preforking *** Aug 31 04:26:21.215399 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: *** uWSGI is running in multiple interpreter mode *** Aug 31 04:26:21.215399 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: spawned uWSGI master process (pid: 105776) Aug 31 04:26:21.215597 dv-cinder-855307-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 04:26:21.216797 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: spawned uWSGI worker 1 (pid: 105777, cores: 1) Aug 31 04:26:21.216797 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: spawned uWSGI worker 2 (pid: 105778, cores: 1) Aug 31 04:26:21.216797 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 04:26:21.861812 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 04:26:21.882689 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 04:26:22.923909 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:26:22.923909 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: from cryptography.utils import int_from_bytes Aug 31 04:26:22.924538 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:26:22.924538 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: from cryptography.utils import int_from_bytes Aug 31 04:26:22.925274 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:26:22.925274 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: from cryptography.utils import int_from_bytes Aug 31 04:26:22.925726 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:26:22.925726 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: from cryptography.utils import int_from_bytes Aug 31 04:26:25.443308 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:26:25.443881 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:26:25.443977 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:26:25.444317 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:26:25.444469 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:26:25.444858 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:26:25.444931 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:26:25.444997 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.445141 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:26:25.445246 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.445502 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:26:25.445649 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.445741 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:26:25.445812 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.446126 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.446275 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.446442 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.446587 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.446882 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447014 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447124 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447236 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447394 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447553 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447650 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447749 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.447913 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.448005 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.448237 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-1-iscsi {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.448336 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.448550 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.448668 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.448812 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.448901 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.449121 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.449217 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.449427 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.449527 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-1-iscsi {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.449726 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.449816 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.450027 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.450124 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.450325 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.450429 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.451043 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.451536 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.451642 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.451642 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.451790 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.451931 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.452044 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.452369 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.452464 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.452703 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.452794 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.453017 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.453112 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.453308 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.453409 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.453625 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.453733 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.453944 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.454057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.454234 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.454357 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.454557 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.454667 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.454860 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.454965 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-1-iscsi {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.455204 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.455303 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.455512 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.455604 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.455856 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.455946 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-1-iscsi {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.456208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.456298 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.456511 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.456618 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.456818 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.456916 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.457135 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.457234 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.457461 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.457553 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.457761 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.457871 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.458078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.458179 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.458387 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.458478 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.458695 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.458806 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.459018 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.459114 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.459312 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.459399 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.459615 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.459702 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.459916 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.460005 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.460210 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.460296 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.460508 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.460600 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.460804 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.460889 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.461057 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.461150 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.461349 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.461436 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.461664 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.461769 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.461917 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.462009 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.462223 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.462324 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.462522 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.462630 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.462795 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.462898 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.463107 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.463217 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.463404 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.463497 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.463653 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.463743 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.463970 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.464059 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.464297 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.464434 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.464579 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.464674 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.464877 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.464972 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.465182 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.465321 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.465471 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.465567 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.465768 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.465856 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.466070 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.466155 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.466484 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.466883 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.466971 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467051 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467130 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467217 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467322 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467420 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467642 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467732 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.467947 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.468033 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.468244 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.468341 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.468574 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.468662 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.468869 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.468954 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.469169 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.469268 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.469486 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.469573 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.469796 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.469889 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.470095 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.470191 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.470392 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.470480 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.470691 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.470798 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471024 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471112 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471326 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471414 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471628 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471716 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471871 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.471959 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.472163 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.472250 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.472468 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.472570 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.472778 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.472884 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.473071 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.473158 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.473369 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.473463 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.473667 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.473762 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.473958 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.474045 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.474257 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.474352 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.474557 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.474653 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.474876 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.474986 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.475173 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.475270 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.475473 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.475571 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.475769 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.475856 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.476068 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.476163 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.476361 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.476455 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.476657 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.476743 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.476959 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.477054 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.477261 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.477347 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.477557 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.477642 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.477854 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.477942 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.478150 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.478248 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.478447 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.478546 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.478766 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.478874 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.479075 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.479162 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.479372 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.479459 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.479686 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.479784 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.479986 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.480117 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.480283 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.480371 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.480591 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.480689 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.480891 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.480988 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.481191 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.481277 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.481502 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.481590 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.481795 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.481941 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.482180 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.482360 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.482632 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.482786 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.482885 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.482974 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.483113 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.483224 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.483424 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.483530 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.483744 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.483876 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.484040 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.484171 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.484314 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.484411 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.484630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.484761 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.484930 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.485076 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.485179 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.485270 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.485517 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.485647 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.485824 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.485966 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.486070 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.486152 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.486409 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.486549 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.486678 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.486859 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.487039 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.487181 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.487345 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.487476 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.487647 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.487861 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.487952 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:26:25.488042 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.488278 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.488408 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.488590 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.488684 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.488911 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.488999 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.489224 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.489313 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.489528 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.489616 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.489838 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.489938 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.490161 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.490251 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.490463 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.490551 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.490798 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.490889 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.491102 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.491210 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.491415 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.491505 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.491723 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.491810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.492032 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.492129 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.492337 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.492439 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.492650 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.492738 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.492960 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.493061 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.493252 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.493357 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.493560 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.493661 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.493893 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.494014 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.494202 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.494291 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.494503 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.494598 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.494844 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.494950 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.495161 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.495250 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.495450 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.495535 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.495761 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.495858 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.496073 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.496166 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.496378 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.496463 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.496680 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.496766 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.496982 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.497076 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.497298 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.497410 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.497747 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.497880 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.498183 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.498274 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.498508 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.498600 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.498841 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.498944 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.499160 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.499260 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.499466 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.499556 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.499771 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.499862 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.500074 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.500165 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.500378 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.500479 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.500680 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.500778 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.500985 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.501082 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.501299 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.501399 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.501604 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.501695 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.501905 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.501995 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.502209 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.502313 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.502521 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.502620 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.502847 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.502938 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.503149 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.503252 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.503450 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.503548 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.503748 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.503839 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.504077 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.504227 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.504319 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.504399 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.504655 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.504786 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.504938 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.505028 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.505236 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.505367 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.505549 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.505720 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.505830 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.505923 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.506140 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.506284 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.506405 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.506497 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.506777 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.506906 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.507013 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.507098 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.507346 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.507491 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.507594 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.507676 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.507929 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.508061 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.508244 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.508389 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.508502 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.508595 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.508835 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.508965 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.509137 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.509279 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.509406 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.509510 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.509744 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.509874 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.510027 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.510211 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.510296 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.510381 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.510616 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.510733 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.510935 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.511043 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.511246 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.511336 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.511548 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.511636 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.511851 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.511940 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.512156 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.512245 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.512464 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.512553 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.512761 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.512857 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.513076 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.513234 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.513423 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.513563 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.513776 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.513865 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.514097 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.514193 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.514418 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.514516 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.514836 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.514942 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.515042 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.515138 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.515351 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.515450 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.515653 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.515742 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.515948 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.516044 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.516244 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.516342 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.516543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.516637 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.516835 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.516931 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.517130 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.517226 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.517421 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.517510 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.517702 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.517788 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.517997 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.518095 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.518293 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.518377 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.518595 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.518679 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.518916 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.519014 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.519213 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.519305 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.519511 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.519597 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.519809 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.519893 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.520108 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.520201 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.520408 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.520493 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.520745 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.520833 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.521053 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.521145 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.521361 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.521445 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.521666 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.521753 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.521976 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.522061 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.522276 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.522371 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.522584 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.522676 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.522911 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.523005 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.523211 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.523306 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.523515 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.523640 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.523816 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.523899 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.524120 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.524248 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.524418 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.524510 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.524728 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.524811 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.525027 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.525160 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.525333 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.525417 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.525624 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.525707 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.525932 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.526025 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.526245 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.526329 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.526546 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.526631 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.526882 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.526982 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.527193 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.527277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.527494 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.527581 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.527800 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.527888 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.528101 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.528187 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.528404 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.528488 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.528754 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.528845 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.529067 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.529193 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.529378 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.529633 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.529727 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.529945 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.530039 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.530253 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.530339 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.530563 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.530655 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.530892 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.530980 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.531203 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.531288 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.531500 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.531586 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.531805 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.531891 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.532110 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.532194 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.532424 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.532512 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.532725 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.532810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.533028 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.533111 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.533342 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.533428 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.533644 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.533774 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.533944 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.534029 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.534248 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.534387 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.534545 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.534631 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.534864 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.534965 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.535171 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.535262 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.535479 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.535569 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.535781 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.535878 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.536081 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.536166 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.536386 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.536473 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.536696 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.536789 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.536992 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.537082 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.537290 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.537375 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.537584 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.537678 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.537888 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.537973 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.538189 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.538280 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.538488 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.538577 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.538812 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.538899 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.539123 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.539219 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.539415 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.539501 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.539710 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.539796 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540022 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540107 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540323 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540418 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540618 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540703 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540912 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.540996 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.541207 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.541294 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.541519 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.541603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.541821 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.541918 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.542113 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.542204 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.542415 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.542525 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.542751 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.542860 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.543049 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.543141 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.543352 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.543443 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.543652 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.543745 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.543954 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.544063 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.544259 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.544352 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.544685 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.544781 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.544990 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.545074 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.545294 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.545419 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.545595 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.545680 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.545896 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.545981 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.546198 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.546281 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.546506 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.546592 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.546835 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.546925 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.547140 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.547235 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.547444 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.547537 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.547827 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.547925 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.548038 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.548124 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.548345 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.548431 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.548651 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.548906 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.548991 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.549231 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.549318 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.549539 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.549661 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.549850 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.550100 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.550194 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.550434 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.550526 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.550766 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.550872 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.551091 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.551184 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.551407 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.551493 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.551704 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.551795 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552007 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552102 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552307 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552402 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552605 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552690 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552909 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.552994 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.553209 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.553302 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.553506 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.553591 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.553811 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.553950 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.554108 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.554205 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.554403 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.554489 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.554700 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.554827 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.555020 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.555114 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.555318 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.555404 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.555612 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.555703 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.555910 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.556003 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.556208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.556293 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.556502 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.556593 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.556807 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.556893 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.557107 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.557200 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.557401 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.557484 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.557695 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.557780 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.557989 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.558073 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.558298 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.558381 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.558597 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.558683 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.558918 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.559005 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.559217 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.559314 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.559554 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.559648 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.559855 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.560114 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.560218 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.560307 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.560507 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.560645 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.560802 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.560914 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.561096 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.561218 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.561390 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.561521 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.561692 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.561843 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.561993 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.562157 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.562294 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.562429 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.562598 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.562785 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.562925 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.563066 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.563231 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.563370 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.563533 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.563671 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.563827 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.563978 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.564127 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.564283 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.564422 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.564588 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.564724 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.564895 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.565013 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.565194 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.565307 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.565498 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.565596 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.565795 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.565881 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.566111 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.566197 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.566413 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.566499 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.566723 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.566812 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.567034 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.567119 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.567342 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.567429 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.567647 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.567730 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.567942 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.568034 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.568235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.568321 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.568532 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.568615 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.568830 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.568915 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.569123 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.569209 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.569419 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.569508 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.569718 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.569812 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.570009 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.570093 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.570303 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.570389 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.570597 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.570690 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.570917 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.571003 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.571212 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.571304 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.571512 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.571605 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.571808 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.571891 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.572113 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.572198 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.572407 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.572499 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.572702 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.572786 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.572996 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.573080 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.573291 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.573378 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.573584 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.573670 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.573883 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.573975 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.574178 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.574264 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.574471 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.574557 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.574933 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.575033 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.575127 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.575197 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.575358 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.575444 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.576146 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.576445 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.576745 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.577048 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.577342 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.577657 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.577968 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.578278 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.578570 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.578890 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.579226 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.579525 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.580014 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.580547 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.580880 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.581196 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.581516 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.581840 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.582297 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.582478 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.582852 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.582971 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.583184 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.583276 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.583507 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.583607 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.583825 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.583915 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.584133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.584268 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.584440 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.584533 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.584765 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.584856 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.585081 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.585173 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.585394 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.585486 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.585714 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.585805 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.586036 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.586128 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.586348 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.586438 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.586647 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.586753 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.586982 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.587078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.587293 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.587385 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.587601 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.587694 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.587904 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.587994 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.588201 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.588286 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.588504 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.588595 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.588813 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.588910 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.589121 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.589210 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.589425 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.589518 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.589732 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.589831 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.590034 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.590131 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.590341 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.590436 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.590638 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.590785 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.590962 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.591058 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.591318 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.591424 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.591620 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.591883 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.591977 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.592247 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.592344 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.592550 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.592651 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.592937 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.593032 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.593249 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.593335 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.593559 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.593679 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.593866 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.593994 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.594173 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.594304 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.594477 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.594644 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.594810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.594928 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.595119 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.595234 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.595419 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.595546 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.595740 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.595857 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.596043 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.596159 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.596342 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.596572 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.596658 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.596884 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.596975 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.597190 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.597294 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.597495 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.597591 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.597797 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.597926 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.598094 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.598236 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.598400 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.598542 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.598736 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.598871 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.599040 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.599179 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.599341 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.599487 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.599639 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.599799 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.599959 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.600107 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.600251 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.600404 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.600561 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.600814 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.600972 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.601124 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.601285 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.601429 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.601587 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.601737 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.601999 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.602086 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.602308 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.602401 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.602613 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.602708 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.602953 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.603047 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.603252 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.603338 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.603549 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.603648 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.603845 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.603931 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.604152 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.604237 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.604448 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.604541 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.604761 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.604852 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.605077 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.605238 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.605383 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.605469 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.605693 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.605787 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.605991 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.606146 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.606308 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.606454 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.606626 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.606964 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.607057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.607333 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.607428 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.607715 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.607837 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.608039 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.608141 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.608340 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.608453 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.608651 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.608773 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.608959 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.609096 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.609277 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.609397 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.609595 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.609696 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.609902 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.609995 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.610211 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.610342 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.610508 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.610606 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.610848 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.610982 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.611164 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.611292 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.611470 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.611601 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.611785 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.611909 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.612191 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.612277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.612500 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.612592 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.612798 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.612884 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.613112 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.613196 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.613409 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.613501 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.613718 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.613802 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.614015 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.614111 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.614319 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.614412 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.614619 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.614711 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.614944 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.615041 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.615261 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.615346 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.615555 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.615646 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.615855 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.615948 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.616156 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.616243 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.616458 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.616543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.616757 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.616851 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.617054 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.617141 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.617368 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.617460 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.617663 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.617761 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.617976 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.618076 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.618283 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.618376 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.618598 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.618697 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.618940 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.619036 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.619239 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.619335 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.619554 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.619641 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.619857 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.619948 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.620154 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.620241 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.620451 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.620535 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.620745 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.620836 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.621050 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.621134 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.621350 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.621443 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.621649 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.621740 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.621955 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.622060 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.622255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.622342 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.622618 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.622781 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.622934 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.623035 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.623254 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.623339 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.623555 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.623648 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.623874 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.623972 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.624178 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.624265 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.624481 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.624566 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.624781 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.624874 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.625079 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.625165 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.625400 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.625491 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.625700 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.625787 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.625998 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.626092 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.626299 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.626388 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.626596 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.626682 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.626917 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.627013 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.627213 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.627300 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.627530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.627617 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.627828 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.627923 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.628137 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.628230 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.628437 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.628529 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.628737 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.628822 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.629039 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.629134 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.629337 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.629422 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.629643 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.629738 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.629958 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.630052 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.630275 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.630483 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.630570 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.630842 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.630932 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.631164 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.631252 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.631477 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.631563 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.631788 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.631874 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.632099 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.632190 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.632408 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.632501 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.632715 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.632815 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.633020 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.633106 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.633321 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.633406 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.633625 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.633786 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.633930 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.634023 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.634240 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.634327 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.634559 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.634776 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.634914 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.635104 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.635230 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.635416 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.635594 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.635727 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.635819 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.636032 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.636125 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.636430 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.636524 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.636743 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.636835 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.637051 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.637137 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.637357 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.637451 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.637660 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.637744 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.637966 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.638052 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.638296 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.638384 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.638605 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.638697 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.638940 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.639025 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.639249 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.639336 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.639555 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.639641 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.639859 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.639945 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.640168 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.640256 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.640475 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.640598 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.640794 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.640892 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.641119 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.641212 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.641423 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.641511 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.641728 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.641822 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.642034 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.642124 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.642342 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.642434 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.642644 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.642882 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.642971 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.643200 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.643287 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.643533 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.643627 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.643842 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.643933 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.644147 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.644233 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.644450 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.644548 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.644756 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.644885 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.645073 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.645160 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.645373 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.645471 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.645674 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.645760 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.645980 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.646066 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.646285 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.646404 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.646581 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.646667 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.646923 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.647112 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.647232 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.647424 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.647524 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.647750 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.647853 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.648064 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.648159 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.648382 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.648641 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.648727 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.648986 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.649083 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.649296 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.649389 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.649592 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.649684 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.649889 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.649984 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.650193 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.650290 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.650497 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.650584 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.650819 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.650931 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.651136 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.651222 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.651439 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.651530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.651731 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.651829 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.652041 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.652125 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.652341 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.652434 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.652640 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.652861 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.652947 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.653206 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.653292 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.653518 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.653619 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.653908 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.654014 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.654247 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.654332 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.654574 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.654670 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.654905 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.655002 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.655208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.655300 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.655507 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.655602 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.655816 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.655902 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.656118 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.656210 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.656419 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.656559 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.656721 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.656812 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657017 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657101 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657319 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657405 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657614 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657706 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657910 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.657995 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.658207 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.658293 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.658502 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.658588 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.658828 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.658917 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.659135 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.659228 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.659435 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.659527 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.659732 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.659827 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.660040 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.660126 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.660339 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.660426 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.660634 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.660733 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.660931 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.661017 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.661227 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.661313 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.661529 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.661628 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.661827 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.661919 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.662133 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.662219 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.662431 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.662597 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.662750 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.663050 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.663189 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.663340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.663435 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.663658 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.663757 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.663979 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.664063 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.664279 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.664378 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.664575 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.664660 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.664880 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.664975 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.665180 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.665273 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.665496 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.665588 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.665801 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.665892 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.666105 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.666197 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.666409 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.666494 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.666736 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.666828 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.667050 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.667280 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.667366 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.667613 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.667699 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.667930 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.668024 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.668233 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.668317 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.668536 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.668622 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.668844 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.668944 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.669139 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.669230 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.669469 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.669564 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.669799 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.669997 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.670116 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.670353 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.670444 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.670690 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.670853 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.671020 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.671118 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.671325 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.671412 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.671627 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.671722 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.671930 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.672016 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.672236 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.672327 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.672539 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.672632 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.672839 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.672925 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.673140 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.673224 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.673441 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.673533 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.673743 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.673829 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.674045 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.674132 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.674349 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.674435 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.674681 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.674797 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.675021 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.675108 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.675334 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.675421 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.675643 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.675736 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.675952 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.676047 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.676255 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.676340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.676556 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.676649 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.676857 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.676952 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.677157 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.677251 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.677465 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.677552 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.677784 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.677879 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.678089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.678176 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.678388 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.678480 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.678762 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.678866 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.679052 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.679146 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.679351 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.679437 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.679652 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.679746 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.679957 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.680050 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.680273 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.680358 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.680579 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.680675 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.680884 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.681006 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.681186 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.681282 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.681491 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.681576 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.681790 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.681882 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.682093 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.682191 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.682392 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.682478 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.682691 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.682834 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.683023 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.683121 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.683318 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.683411 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.683617 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.683708 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.683913 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.684010 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.684212 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.684299 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.684509 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.684594 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.684804 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.684890 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.685154 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.685289 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.685496 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.685603 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.685797 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.685920 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.686095 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.686220 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.686394 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.686522 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.686690 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.686856 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.687017 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.687157 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.687312 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.687486 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.687609 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.687798 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.687906 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.688115 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.688209 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.688424 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.688518 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.688740 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.688826 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.689046 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.689131 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.689341 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.689436 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.689638 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.689726 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.689934 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.690061 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.690246 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.690385 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.690578 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.690685 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.690912 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.691085 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.691228 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.691347 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.691538 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.691660 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.691846 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.691985 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.692155 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.692294 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.692464 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.692609 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.692793 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.692912 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.693120 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.693213 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.693471 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.693564 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.693748 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.693844 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.694066 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.694152 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.694382 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.694467 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.694698 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.694816 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.695029 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.695115 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.695334 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.695419 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.695641 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.695728 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.695948 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.696033 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.696252 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.696345 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.696557 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.696642 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.696865 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.696952 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.697167 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.697259 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.697472 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.697557 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.697783 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.697870 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.698096 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.698192 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.698405 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.698489 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.698710 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.698885 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.699054 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.699154 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.699361 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.699446 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.699664 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.699754 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.699969 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.700064 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.700274 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.700361 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.700607 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.701053 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.701342 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.701428 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.701669 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.701755 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.701979 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.702063 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.702284 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.702369 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.702583 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.702677 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.702875 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:26:25.702974 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.703236 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.703543 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.703861 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.704182 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.704528 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.704975 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.705174 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.705499 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.705808 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.706113 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.706411 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:26:25.706650 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:26:25.859275 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO dbcounter [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Registered counter for database nova_api Aug 31 04:26:25.862748 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO dbcounter [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Registered counter for database nova_api Aug 31 04:26:25.879561 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_db.sqlalchemy.engines [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:25.882255 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_db.sqlalchemy.engines [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:25.886492 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writer thread running {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:25.889263 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writer thread running {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:25.941572 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.context [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04318292-e935-4b51-a3d6-6ee7b9045164(cell1) {{(pid=105777) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 04:26:25.945541 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:26:25.945941 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:26:25.946188 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.context [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04318292-e935-4b51-a3d6-6ee7b9045164(cell1) {{(pid=105778) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 04:26:25.947534 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:26:25.948250 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:26:25.948682 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:26:25.950095 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_concurrency.lockutils [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:26:25.950593 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_concurrency.lockutils [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:26:25.951105 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:26:25.952581 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_concurrency.lockutils [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:26:25.953029 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO dbcounter [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Registered counter for database nova_cell0 Aug 31 04:26:25.953264 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_concurrency.lockutils [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:26:25.953700 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_concurrency.lockutils [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:26:25.955692 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_concurrency.lockutils [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:26:25.957692 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO dbcounter [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Registered counter for database nova_cell0 Aug 31 04:26:25.958470 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO dbcounter [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Registered counter for database nova_cell1 Aug 31 04:26:25.961699 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO dbcounter [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Registered counter for database nova_cell1 Aug 31 04:26:25.966479 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_db.sqlalchemy.engines [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:25.968592 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_db.sqlalchemy.engines [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:25.971314 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_db.sqlalchemy.engines [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:25.972449 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_db.sqlalchemy.engines [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:25.973009 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writer thread running {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:25.979043 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writer thread running {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:25.979771 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writer thread running {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:25.980516 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writer thread running {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:26.121618 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO dbcounter [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Registered counter for database nova_cell0 Aug 31 04:26:26.124016 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO dbcounter [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Registered counter for database nova_cell0 Aug 31 04:26:26.133710 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_db.sqlalchemy.engines [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:26.137663 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG oslo_db.sqlalchemy.engines [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:26:26.139405 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writer thread running {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:26.143872 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writer thread running {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:26:26.476512 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: WARNING keystonemiddleware.auth_token [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:26:26.477074 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: WARNING keystonemiddleware.auth_token [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:26:26.483774 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: WARNING keystonemiddleware.auth_token [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:26:26.484374 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: WARNING keystonemiddleware.auth_token [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:26:26.826822 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: WARNING keystonemiddleware.auth_token [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:26:26.827044 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: WARNING keystonemiddleware.auth_token [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:26:26.832868 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: WARNING keystonemiddleware.auth_token [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:26:26.833024 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: WARNING keystonemiddleware.auth_token [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:26:26.838123 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f2ac2019c0 pid: 105778 (default app) Aug 31 04:26:26.838256 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f2ac2019c0 pid: 105777 (default app) Aug 31 04:26:26.840221 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:26:26.841491 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-4a9973af-b38c-4e24-803c-55147bcdeb18 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Aug 31 04:26:26.841859 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Aug 31 04:26:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:27:45.518292 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:27:45.519561 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002065 Aug 31 04:27:45.520151 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:27:45.535840 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writing DB stats nova_api:SELECT=3 {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:45.537003 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writing DB stats nova_cell0:SELECT=3 {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:45.538053 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writing DB stats nova_cell1:SELECT=3 {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:45.539189 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:46.385221 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-089a7d0b-5bb9-4465-95e0-67e1d18f7a1d admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:27:46.421381 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-089a7d0b-5bb9-4465-95e0-67e1d18f7a1d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.894855 Aug 31 04:27:46.422023 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 04:27:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:27:48.782881 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:27:48.783879 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-16580089-eed5-4e8d-bae3-3d734fcde4f7 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 04:27:48.789900 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:27:49.271002 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-7a7fed35-fac3-44f0-903a-7ceb9fd81bd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:49.332248 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-7a7fed35-fac3-44f0-903a-7ceb9fd81bd9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.541416 Aug 31 04:27:49.333184 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:27:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 04:27:49.346408 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_api:SELECT=3 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:49.347731 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_cell1:SELECT=3 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:49.348859 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_cell0:SELECT=3 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:49.350086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:49.557601 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-10407943-edb7-4118-879e-81db1f2992a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:49.619669 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-10407943-edb7-4118-879e-81db1f2992a5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278540 Aug 31 04:27:49.620251 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 04:27:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:27:51.950188 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-7a7fed35-fac3-44f0-903a-7ceb9fd81bd9 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:27:51.951268 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-7a7fed35-fac3-44f0-903a-7ceb9fd81bd9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Aug 31 04:27:51.951636 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:27:52.630689 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-49221169-5f82-4aba-acd9-ddee133a3d46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "ram": 512, "name": "ds512M"}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:52.673598 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-49221169-5f82-4aba-acd9-ddee133a3d46 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.714427 Aug 31 04:27:52.674634 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:27:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:27:52.687257 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-8dd55ee7-84d7-4b51-a6ca-3da426819210 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:52.725704 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-8dd55ee7-84d7-4b51-a6ca-3da426819210 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042160 Aug 31 04:27:52.726533 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 04:27:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:27:55.083607 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-49221169-5f82-4aba-acd9-ddee133a3d46 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:27:55.085169 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-49221169-5f82-4aba-acd9-ddee133a3d46 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Aug 31 04:27:55.085567 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:27:55.498363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-198e1aa8-6fc7-460a-8d29-57a441046888 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:55.517863 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-198e1aa8-6fc7-460a-8d29-57a441046888 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426227 Aug 31 04:27:55.518490 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:27:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:27:55.531106 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-a6214d60-0991-4937-84c6-384f4f84de21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:55.556408 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-a6214d60-0991-4937-84c6-384f4f84de21 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028982 Aug 31 04:27:55.557238 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 04:27:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:27:57.913180 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-198e1aa8-6fc7-460a-8d29-57a441046888 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:27:57.914934 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-198e1aa8-6fc7-460a-8d29-57a441046888 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 Aug 31 04:27:57.915502 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:27:58.380169 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-2b4ca5f3-2ac3-47dd-93b9-a44694ef15c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "vcpus": 2, "disk": 10, "swap": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:58.402302 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-2b4ca5f3-2ac3-47dd-93b9-a44694ef15c8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480256 Aug 31 04:27:58.403074 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:27:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:27:58.415174 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-623827be-ee34-40d4-b19b-e8fee80d8bdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:27:58.443620 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-623827be-ee34-40d4-b19b-e8fee80d8bdf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032030 Aug 31 04:27:58.444204 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 04:27:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:28:00.760307 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-2b4ca5f3-2ac3-47dd-93b9-a44694ef15c8 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:00.761972 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-2b4ca5f3-2ac3-47dd-93b9-a44694ef15c8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Aug 31 04:28:00.762328 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:01.195742 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-13e35fc5-b00f-4d60-b236-0e8bfc9f093f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "id": "d4"}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:01.217035 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-13e35fc5-b00f-4d60-b236-0e8bfc9f093f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448432 Aug 31 04:28:01.217948 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:28:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 04:28:01.230308 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-34df2a55-7ee7-4fca-850e-e833e2afc30d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:01.256416 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-34df2a55-7ee7-4fca-850e-e833e2afc30d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029930 Aug 31 04:28:01.260927 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 31 04:28:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:28:03.748860 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-13e35fc5-b00f-4d60-b236-0e8bfc9f093f admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:03.750344 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-13e35fc5-b00f-4d60-b236-0e8bfc9f093f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002317 Aug 31 04:28:03.750969 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:04.228691 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-97adafde-bf6b-4442-8752-93500eb54be5 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:04.254467 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-97adafde-bf6b-4442-8752-93500eb54be5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.496783 Aug 31 04:28:04.255074 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 04:28:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:28:06.631761 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-13e35fc5-b00f-4d60-b236-0e8bfc9f093f admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:06.633110 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-13e35fc5-b00f-4d60-b236-0e8bfc9f093f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 Aug 31 04:28:06.633696 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:07.095435 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-dbce3836-664e-492b-be1f-d2f4e50e6449 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:07.119313 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-dbce3836-664e-492b-be1f-d2f4e50e6449 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.477514 Aug 31 04:28:07.119845 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:28:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:07.133471 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-c21cd106-c51b-4195-8a36-5e5afbd55f77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:07.164762 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-c21cd106-c51b-4195-8a36-5e5afbd55f77 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035472 Aug 31 04:28:07.165633 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 04:28:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:28:09.501406 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-dbce3836-664e-492b-be1f-d2f4e50e6449 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:09.502604 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-dbce3836-664e-492b-be1f-d2f4e50e6449 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Aug 31 04:28:09.503241 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:09.904993 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-eb795307-6d2f-4c7a-8795-5ae0aa9aab7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "swap": 0}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:09.925995 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-eb795307-6d2f-4c7a-8795-5ae0aa9aab7d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416601 Aug 31 04:28:09.926546 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:28:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:09.938482 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-ab1526b4-81b4-498f-a9cd-2ebd42674306 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:09.964393 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-ab1526b4-81b4-498f-a9cd-2ebd42674306 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029708 Aug 31 04:28:09.964968 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 04:28:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:28:12.293538 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-eb795307-6d2f-4c7a-8795-5ae0aa9aab7d admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:12.294463 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-eb795307-6d2f-4c7a-8795-5ae0aa9aab7d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 04:28:12.294891 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:12.710084 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-cca27c09-22d4-426d-b328-019da68af940 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:12.734588 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-cca27c09-22d4-426d-b328-019da68af940 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.432804 Aug 31 04:28:12.736237 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:28:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:12.749305 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-a7909f22-352a-4b24-a11c-a753a4e1ddce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:12.776197 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-a7909f22-352a-4b24-a11c-a753a4e1ddce admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032092 Aug 31 04:28:12.777128 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 04:28:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:28:15.115080 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-cca27c09-22d4-426d-b328-019da68af940 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:15.116095 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-cca27c09-22d4-426d-b328-019da68af940 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 31 04:28:15.116492 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:15.560058 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-51049617-60e5-42b1-9bec-936142063c2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "id": "4", "ram": 8192, "disk": 80, "vcpus": 4}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:15.574740 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:15.582023 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-51049617-60e5-42b1-9bec-936142063c2a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459475 Aug 31 04:28:15.582859 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:28:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:15.594907 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-849698de-c9fb-4618-9520-12865051f74c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:15.621218 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-849698de-c9fb-4618-9520-12865051f74c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029974 Aug 31 04:28:15.621802 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 04:28:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:28:17.997686 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-51049617-60e5-42b1-9bec-936142063c2a admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:17.998735 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-51049617-60e5-42b1-9bec-936142063c2a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 31 04:28:18.004570 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:18.485518 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-a81167a0-0d97-4454-ae6b-d398b866a749 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "disk": 160}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:18.507935 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-a81167a0-0d97-4454-ae6b-d398b866a749 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.502392 Aug 31 04:28:18.508588 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 31 04:28:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:18.520479 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-84b90341-273b-4e0b-b653-43e392e0f262 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:18.546982 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-84b90341-273b-4e0b-b653-43e392e0f262 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030138 Aug 31 04:28:18.547847 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 31 04:28:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:28:37.496880 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-a81167a0-0d97-4454-ae6b-d398b866a749 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:37.498360 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-a81167a0-0d97-4454-ae6b-d398b866a749 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002284 Aug 31 04:28:37.499048 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:37.512948 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writing DB stats nova_api:SELECT=7,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:37.940811 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-ac13bc67-c6f7-4f8f-9d48-afeff80321d3 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:37.968074 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-ac13bc67-c6f7-4f8f-9d48-afeff80321d3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.462501 Aug 31 04:28:37.968585 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 04:28:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:28:39.033588 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-a81167a0-0d97-4454-ae6b-d398b866a749 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:39.034586 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-a81167a0-0d97-4454-ae6b-d398b866a749 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 04:28:39.035040 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:39.633347 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-97db474b-dae8-4dbc-a20e-cee59f414b10 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:39.639133 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.wsgi [None req-97db474b-dae8-4dbc-a20e-cee59f414b10 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-97db474b-dae8-4dbc-a20e-cee59f414b10 admin admin] Request method failure captured: Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Accept: application/json Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Accept-Encoding: gzip, deflate Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Connection: keep-alive Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Content-Length: 0 Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Host: 10.222.0.42 Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Openstack-Api-Version: compute 2.90 Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Openstack-System-Scope: None Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: User-Agent: python-novaclient Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Auth-Token: gAAAAABjDuN2A9MGUMZ0wpGVPOu6mx-PGFTl_P64Zh0IQ_a62v6k8HwsVWT0pE-SXDcbrRSEcH4xNZd1T02OaQvc_n3t9ci_LEeR2Kc1FmVs33K3IsMrrsY3YOoKp37WMDkmmQiM1jlAv8Ss25n4X0MQtyWEjiUZ5f6wPDDMfYgNyqyXIOAX9nU Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Domain-Id: None Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Domain-Name: None Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Identity-Status: Confirmed Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Is-Admin-Project: True Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Domain-Id: default Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Domain-Name: Default Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Name: admin Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Role: reader,member,admin Aug 31 04:28:39.642363 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Roles: reader,member,admin Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_529acf6d876d441682b1d4508345bc61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/529acf6d876d441682b1d4508345bc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}] Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant: admin Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant-Name: admin Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User: admin Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Domain-Id: default Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Domain-Name: Default Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Id: 13d95fead9ed4b918730e2198000e5e5 Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Name: admin Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: method: > Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: exception: Flavor 42 could not be found. Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: action_args: {'id': '42'} Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:28:39.643920 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:39.644810 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.646078 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-97db474b-dae8-4dbc-a20e-cee59f414b10 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:28:39.647225 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-97db474b-dae8-4dbc-a20e-cee59f414b10 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.472514 Aug 31 04:28:39.647225 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 04:28:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:28:39.654296 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-c66086b3-b93d-4606-8d46-059b9372edee admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:39.658586 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:39.679102 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-c66086b3-b93d-4606-8d46-059b9372edee admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028428 Aug 31 04:28:39.679645 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 04:28:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:28:39.689576 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-8e91a0f6-a3e0-4d6f-bd72-5289f61e3fe1 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:39.712447 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-8e91a0f6-a3e0-4d6f-bd72-5289f61e3fe1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026465 Aug 31 04:28:39.712947 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 04:28:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:28:39.722816 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-f7d0758a-77cd-45bb-a6b5-cc9686971bd9 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:39.728759 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.wsgi [None req-f7d0758a-77cd-45bb-a6b5-cc9686971bd9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-f7d0758a-77cd-45bb-a6b5-cc9686971bd9 admin admin] Request method failure captured: Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Accept: application/json Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Accept-Encoding: gzip, deflate Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Connection: keep-alive Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Content-Length: 0 Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Host: 10.222.0.42 Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Openstack-Api-Version: compute 2.90 Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Openstack-System-Scope: None Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: User-Agent: python-novaclient Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Auth-Token: gAAAAABjDuN2A9MGUMZ0wpGVPOu6mx-PGFTl_P64Zh0IQ_a62v6k8HwsVWT0pE-SXDcbrRSEcH4xNZd1T02OaQvc_n3t9ci_LEeR2Kc1FmVs33K3IsMrrsY3YOoKp37WMDkmmQiM1jlAv8Ss25n4X0MQtyWEjiUZ5f6wPDDMfYgNyqyXIOAX9nU Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Domain-Id: None Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Domain-Name: None Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Identity-Status: Confirmed Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Is-Admin-Project: True Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Domain-Id: default Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Domain-Name: Default Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Name: admin Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Role: reader,member,admin Aug 31 04:28:39.732057 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Roles: reader,member,admin Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_529acf6d876d441682b1d4508345bc61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/529acf6d876d441682b1d4508345bc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}] Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant: admin Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant-Name: admin Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User: admin Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Domain-Id: default Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Domain-Name: Default Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Id: 13d95fead9ed4b918730e2198000e5e5 Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Name: admin Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: method: > Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: exception: Flavor 42 could not be found. Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: action_args: {'id': '42'} Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:28:39.733340 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:39.734133 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:39.735277 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-f7d0758a-77cd-45bb-a6b5-cc9686971bd9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:28:39.736373 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-f7d0758a-77cd-45bb-a6b5-cc9686971bd9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014654 Aug 31 04:28:39.736373 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 04:28:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:28:40.717413 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-8e91a0f6-a3e0-4d6f-bd72-5289f61e3fe1 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:40.718443 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-8e91a0f6-a3e0-4d6f-bd72-5289f61e3fe1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 04:28:40.718861 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:41.278231 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-bc839a0f-9704-4820-91d3-db3299b8d5c9 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:41.286983 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.wsgi [None req-bc839a0f-9704-4820-91d3-db3299b8d5c9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-bc839a0f-9704-4820-91d3-db3299b8d5c9 admin admin] Request method failure captured: Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Accept: application/json Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Accept-Encoding: gzip, deflate Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Connection: keep-alive Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Content-Length: 0 Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Host: 10.222.0.42 Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Openstack-Api-Version: compute 2.90 Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Openstack-System-Scope: None Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: User-Agent: python-novaclient Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Auth-Token: gAAAAABjDuN4TY_3yB-drckEk-1HBFE-8GyabvqunE6TmrLZuEEffNEtotKlxGOFCWTt2aaRYOXPa0CWup2hkjF97FVtMX9-pwJRC2YQDaKNMsBuv3-MOoiXAAtZyrsJxRlrIMRnAbzUut_hFN7tGwls4v4EuS-avq_aixxrz3F3EfDdRD8ouVQ Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Domain-Id: None Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Domain-Name: None Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Identity-Status: Confirmed Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Is-Admin-Project: True Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Domain-Id: default Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Domain-Name: Default Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Name: admin Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Role: reader,member,admin Aug 31 04:28:41.288526 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Roles: reader,member,admin Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_529acf6d876d441682b1d4508345bc61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/529acf6d876d441682b1d4508345bc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}] Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant: admin Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant-Name: admin Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User: admin Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Domain-Id: default Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Domain-Name: Default Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Id: 13d95fead9ed4b918730e2198000e5e5 Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Name: admin Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: method: > Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: exception: Flavor 84 could not be found. Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: action_args: {'id': '84'} Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:28:41.290086 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:41.291208 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.292543 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-bc839a0f-9704-4820-91d3-db3299b8d5c9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:28:41.293834 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-bc839a0f-9704-4820-91d3-db3299b8d5c9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.434908 Aug 31 04:28:41.293834 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 04:28:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:28:41.299774 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-dd849397-c054-41c0-b390-14bb96a55a06 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:41.315226 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-dd849397-c054-41c0-b390-14bb96a55a06 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019037 Aug 31 04:28:41.315722 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 04:28:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:28:41.325420 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-f9da16c9-171d-4daf-8d9c-ead974a39929 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:41.341494 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-f9da16c9-171d-4daf-8d9c-ead974a39929 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019582 Aug 31 04:28:41.341982 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 04:28:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:28:41.351608 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-98bafdc4-b8c3-4ac4-a45f-cca3766d1558 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:41.357474 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.wsgi [None req-98bafdc4-b8c3-4ac4-a45f-cca3766d1558 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-98bafdc4-b8c3-4ac4-a45f-cca3766d1558 admin admin] Request method failure captured: Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Accept: application/json Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Accept-Encoding: gzip, deflate Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Connection: keep-alive Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Content-Length: 0 Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Host: 10.222.0.42 Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Openstack-Api-Version: compute 2.90 Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Openstack-System-Scope: None Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: User-Agent: python-novaclient Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Auth-Token: gAAAAABjDuN4TY_3yB-drckEk-1HBFE-8GyabvqunE6TmrLZuEEffNEtotKlxGOFCWTt2aaRYOXPa0CWup2hkjF97FVtMX9-pwJRC2YQDaKNMsBuv3-MOoiXAAtZyrsJxRlrIMRnAbzUut_hFN7tGwls4v4EuS-avq_aixxrz3F3EfDdRD8ouVQ Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Domain-Id: None Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Domain-Name: None Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Identity-Status: Confirmed Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Is-Admin-Project: True Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Domain-Id: default Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Domain-Name: Default Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Name: admin Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Role: reader,member,admin Aug 31 04:28:41.359089 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Roles: reader,member,admin Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_529acf6d876d441682b1d4508345bc61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/529acf6d876d441682b1d4508345bc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}] Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant: admin Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant-Name: admin Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User: admin Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Domain-Id: default Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Domain-Name: Default Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Id: 13d95fead9ed4b918730e2198000e5e5 Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Name: admin Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: method: > Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: exception: Flavor 84 could not be found. Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: action_args: {'id': '84'} Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:28:41.360603 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:41.361705 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:41.363235 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-98bafdc4-b8c3-4ac4-a45f-cca3766d1558 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:28:41.365659 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-98bafdc4-b8c3-4ac4-a45f-cca3766d1558 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012520 Aug 31 04:28:41.365659 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 31 04:28:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 04:28:42.366131 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-f9da16c9-171d-4daf-8d9c-ead974a39929 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:42.367178 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-f9da16c9-171d-4daf-8d9c-ead974a39929 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 31 04:28:42.367566 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:42.946869 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-c71b120e-aaf2-4351-b5db-1b488fd16c7c admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:42.953162 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.wsgi [None req-c71b120e-aaf2-4351-b5db-1b488fd16c7c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-c71b120e-aaf2-4351-b5db-1b488fd16c7c admin admin] Request method failure captured: Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Accept: application/json Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Accept-Encoding: gzip, deflate Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Connection: keep-alive Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Content-Length: 0 Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Host: 10.222.0.42 Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Openstack-Api-Version: compute 2.90 Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Openstack-System-Scope: None Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: User-Agent: python-novaclient Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Auth-Token: gAAAAABjDuN6o6QoGkJdIMVQABuFLtFjaSqN4084hFM5MBYhuhNKBGA4zfMTP6dfWJtLFbUwFM6k8bfsKja8zFNHw85_CnyiLSOWz0v9Ele_7D2gMHBrA3Di1-smhQ8AKYLR-IPnl6PSTLpL8K88VxOzKgd1X-gsXZeXk4b-k0M7aPqLeIbZcoc Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Domain-Id: None Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Domain-Name: None Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Identity-Status: Confirmed Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Is-Admin-Project: True Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Domain-Id: default Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Domain-Name: Default Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Project-Name: admin Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Role: reader,member,admin Aug 31 04:28:42.954630 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Roles: reader,member,admin Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_529acf6d876d441682b1d4508345bc61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/529acf6d876d441682b1d4508345bc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}] Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant: admin Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-Tenant-Name: admin Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User: admin Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Domain-Id: default Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Domain-Name: Default Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Id: 13d95fead9ed4b918730e2198000e5e5 Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: X-User-Name: admin Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: method: > Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: exception: Flavor 451 could not be found. Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: action_args: {'id': '451'} Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:28:42.956530 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:42.957465 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: ERROR nova.api.openstack.wsgi Aug 31 04:28:42.959001 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-c71b120e-aaf2-4351-b5db-1b488fd16c7c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:28:42.960309 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-c71b120e-aaf2-4351-b5db-1b488fd16c7c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.451769 Aug 31 04:28:42.960309 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 04:28:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:28:42.966397 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-72152ef0-867b-412a-bad5-f70080dc0ab5 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:42.982194 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-72152ef0-867b-412a-bad5-f70080dc0ab5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019361 Aug 31 04:28:42.982707 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 04:28:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:28:42.994399 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:43.009822 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019136 Aug 31 04:28:43.010353 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 31 04:28:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:28:43.019980 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-91742f28-89f9-4b29-9e5d-8f98395c230f admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:43.025718 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.wsgi [None req-91742f28-89f9-4b29-9e5d-8f98395c230f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-91742f28-89f9-4b29-9e5d-8f98395c230f admin admin] Request method failure captured: Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Accept: application/json Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Accept-Encoding: gzip, deflate Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Connection: keep-alive Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Content-Length: 0 Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Host: 10.222.0.42 Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Openstack-Api-Version: compute 2.90 Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Openstack-System-Scope: None Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: User-Agent: python-novaclient Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Auth-Token: gAAAAABjDuN6o6QoGkJdIMVQABuFLtFjaSqN4084hFM5MBYhuhNKBGA4zfMTP6dfWJtLFbUwFM6k8bfsKja8zFNHw85_CnyiLSOWz0v9Ele_7D2gMHBrA3Di1-smhQ8AKYLR-IPnl6PSTLpL8K88VxOzKgd1X-gsXZeXk4b-k0M7aPqLeIbZcoc Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Domain-Id: None Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Domain-Name: None Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Identity-Status: Confirmed Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Is-Admin-Project: True Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Domain-Id: default Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Domain-Name: Default Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Project-Name: admin Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Role: reader,member,admin Aug 31 04:28:43.027255 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Roles: reader,member,admin Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_529acf6d876d441682b1d4508345bc61", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/529acf6d876d441682b1d4508345bc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/529acf6d876d441682b1d4508345bc61"}]}] Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant: admin Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant-Id: 529acf6d876d441682b1d4508345bc61 Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-Tenant-Name: admin Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User: admin Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Domain-Id: default Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Domain-Name: Default Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Id: 13d95fead9ed4b918730e2198000e5e5 Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: X-User-Name: admin Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: method: > Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: exception: Flavor 451 could not be found. Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: action_args: {'id': '451'} Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:28:43.028873 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:43.029729 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: ERROR nova.api.openstack.wsgi Aug 31 04:28:43.031065 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-91742f28-89f9-4b29-9e5d-8f98395c230f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:28:43.032303 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-91742f28-89f9-4b29-9e5d-8f98395c230f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012219 Aug 31 04:28:43.032303 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 04:28:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:28:44.014639 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:44.015681 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 31 04:28:44.016067 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:44.584386 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-06d57c2b-7008-4e2f-b4c4-06b0cd3484a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:44.608245 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-06d57c2b-7008-4e2f-b4c4-06b0cd3484a2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.458001 Aug 31 04:28:44.608827 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 04:28:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:45.588845 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:45.589856 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 31 04:28:45.590247 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:46.160667 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-64ded947-5f22-42bc-9a34-4a2a7ac8ae94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:46.182512 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-64ded947-5f22-42bc-9a34-4a2a7ac8ae94 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.450876 Aug 31 04:28:46.183085 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 04:28:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:47.185261 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:47.186255 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 31 04:28:47.186645 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:47.777196 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-0255bd7f-6192-4b9c-ad93-765a0b489816 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:47.803052 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-0255bd7f-6192-4b9c-ad93-765a0b489816 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.476844 Aug 31 04:28:47.803762 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 04:28:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:48.795979 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:48.796988 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 04:28:48.797449 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:49.351656 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-7e5aa2b3-a896-4ceb-b5e1-a2cba9b48d68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:28:49.374101 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-7e5aa2b3-a896-4ceb-b5e1-a2cba9b48d68 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.433571 Aug 31 04:28:49.374636 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 31 04:28:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:50.356321 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:50.357677 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Aug 31 04:28:50.358170 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:28:50.931708 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-e8cc29f5-ba3f-4c25-a04b-1834e760014f admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:28:50.952636 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-e8cc29f5-ba3f-4c25-a04b-1834e760014f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.455703 Aug 31 04:28:50.953178 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Aug 31 04:28:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:29:44.949244 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:29:44.950370 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-1312072f-ca94-4482-8983-1a5846c68523 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Aug 31 04:29:44.950876 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 31 04:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:29:44.962012 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:29:45.371076 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-2641699d-40cd-4ea3-8686-ad04ca9059ae admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:29:45.392320 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-2641699d-40cd-4ea3-8686-ad04ca9059ae admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435205 Aug 31 04:29:45.392870 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 31 04:29:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:29:45.416365 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG dbcounter [-] [105778] Writing DB stats nova_api:SELECT=14 {{(pid=105778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:29:45.420470 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-2390944e-fd9d-42b7-95fb-22035d3afd69 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:29:45.428626 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-2390944e-fd9d-42b7-95fb-22035d3afd69 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013760 Aug 31 04:29:45.429151 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 31 04:29:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:29:45.444073 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-490dfecc-5cb2-4ebf-94cd-855d126345f6 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:29:45.456854 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-490dfecc-5cb2-4ebf-94cd-855d126345f6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018600 Aug 31 04:29:45.457599 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 31 04:29:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:29:45.469500 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:29:45.477263 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011455 Aug 31 04:29:45.478172 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 31 04:29:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:29:45.490215 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-26e2c0be-3e25-401d-8648-2438d6ef18da admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:29:45.498508 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-26e2c0be-3e25-401d-8648-2438d6ef18da admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011910 Aug 31 04:29:45.499070 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 31 04:29:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:32:42.509328 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:42.510337 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 31 04:32:42.510744 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:32:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:32:42.652709 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_api:SELECT=6 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:32:42.831039 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:42.834925 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:42.835398 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:42.835816 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:42.836516 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:42.836952 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:42.837359 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:42.871709 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-fa0e64be-dc59-4e6a-8f08-76fe91b05a78 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.221656 Aug 31 04:32:42.872285 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 04:32:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:32:43.706484 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:43.707621 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 31 04:32:43.708028 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:32:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:32:43.901036 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:43.904478 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:43.904878 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:43.905292 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:43.906007 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:43.906443 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:43.906881 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:43.926957 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-4f21b620-a745-4232-beac-f80339fada0a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078942 Aug 31 04:32:43.927516 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 04:32:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:32:55.172007 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:55.173323 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Aug 31 04:32:55.173805 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:32:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:32:55.318197 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_cell0:SELECT=4 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:32:55.318955 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_cell1:SELECT=4 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:32:55.320479 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG dbcounter [-] [105777] Writing DB stats nova_api:SELECT=8 {{(pid=105777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:32:55.379770 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:55.383241 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:55.383767 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:55.384186 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:55.384890 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:55.385330 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:55.385737 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:55.410327 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-6975b7c7-84ed-42ad-beae-abbbcc54f3c9 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.096626 Aug 31 04:32:55.410894 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 04:32:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:32:56.274406 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: DEBUG nova.api.openstack.wsgi [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] Calling method '>' {{(pid=105778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:56.275459 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: INFO nova.api.openstack.requestlog [None req-74a709e0-c40c-4a85-a2d7-3007619ae297 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 31 04:32:56.275867 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: [pid: 105778|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 31 04:32:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:32:56.475615 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG nova.api.openstack.wsgi [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] Calling method '>' {{(pid=105777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:32:56.480637 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:56.481224 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:56.481810 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:56.482829 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:32:56.483415 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:32:56.483941 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: DEBUG oslo_concurrency.lockutils [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:32:56.507571 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: INFO nova.api.openstack.requestlog [None req-6b0bcf71-d598-4ce6-99b0-5da570eb0736 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092503 Aug 31 04:32:56.508137 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: [pid: 105777|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 31 04:32:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:33:52.170571 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: Wed Aug 31 04:33:52 2022 - graceful shutdown triggered... Aug 31 04:33:52.170619 dv-cinder-855307-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 04:33:52.171658 dv-cinder-855307-1-iscsi devstack@n-api.service[105777]: Gracefully killing worker 1 (pid: 105777)... Aug 31 04:33:52.173101 dv-cinder-855307-1-iscsi devstack@n-api.service[105778]: Gracefully killing worker 2 (pid: 105778)... Aug 31 04:33:53.172514 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: worker 1 buried after 1 seconds Aug 31 04:33:53.172514 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: worker 2 buried after 1 seconds Aug 31 04:33:53.172514 dv-cinder-855307-1-iscsi devstack@n-api.service[105776]: goodbye to uWSGI. Aug 31 04:33:53.175426 dv-cinder-855307-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 04:33:53.176347 dv-cinder-855307-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 04:33:53.180836 dv-cinder-855307-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 04:33:53.197584 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 04:33:53 2022] *** Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: nodename: dv-cinder-855307-1-iscsi Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: machine: x86_64 Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: clock source: unix Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: pcre jit disabled Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: detected number of CPU cores: 4 Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: current working directory: / Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: detected binary path: /usr/bin/uwsgi-core Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: your processes number limit is 47680 Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: your memory page size is 4096 bytes Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: detected max file descriptor number: 2048 Aug 31 04:33:53.200733 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: lock engine: pthread robust mutexes Aug 31 04:33:53.201719 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: thunder lock: enabled Aug 31 04:33:53.201719 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 04:33:53.201719 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 04:33:53.243822 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: Python main interpreter initialized at 0x55d7a7b999c0 Aug 31 04:33:53.243822 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: python threads support enabled Aug 31 04:33:53.243822 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: your server socket listen backlog is limited to 100 connections Aug 31 04:33:53.243822 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: your mercy for graceful operations on workers is 90 seconds Aug 31 04:33:53.244311 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 04:33:53.244311 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: *** Operational MODE: preforking *** Aug 31 04:33:53.244599 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: *** uWSGI is running in multiple interpreter mode *** Aug 31 04:33:53.244599 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: spawned uWSGI master process (pid: 127180) Aug 31 04:33:53.244828 dv-cinder-855307-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 04:33:53.246433 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: spawned uWSGI worker 1 (pid: 127197, cores: 1) Aug 31 04:33:53.246433 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: spawned uWSGI worker 2 (pid: 127198, cores: 1) Aug 31 04:33:53.246433 dv-cinder-855307-1-iscsi devstack@n-api.service[127180]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 04:33:53.899604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 04:33:53.906931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 04:33:55.039771 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:33:55.039771 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: from cryptography.utils import int_from_bytes Aug 31 04:33:55.040423 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:33:55.040423 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: from cryptography.utils import int_from_bytes Aug 31 04:33:55.041374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:33:55.041374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: from cryptography.utils import int_from_bytes Aug 31 04:33:55.041804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:33:55.041804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: from cryptography.utils import int_from_bytes Aug 31 04:33:57.404346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:33:57.404927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:33:57.405016 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:33:57.405350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:33:57.405601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:33:57.406008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.406301 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.406645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.406968 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.407432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.407770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.408068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.408391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.408885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.409145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.409459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.409815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-1-iscsi {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.410095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.410400 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.410704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.411051 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.411354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.411671 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.411976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.412471 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.412808 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:33:57.413216 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:33:57.413303 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.413499 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.413608 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:33:57.413922 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.414144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:33:57.414144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:33:57.414588 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.414865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.415090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.415090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.415512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.415728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.415977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.416192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.416396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.416626 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.416957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.417200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.417414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.417641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-1-iscsi {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.417857 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.418081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.418296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.418615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.419077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.419316 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.419511 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.419685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.419923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.420073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.420230 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855307-1-iscsi {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.420384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.420573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.420728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.420911 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.421070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.421220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.421400 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.421400 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.421699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.421851 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.422038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.422181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.422387 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.422602 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.422862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.423015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.423015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.423424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.423639 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.423790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.423911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.424034 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.424635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.424783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.424945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.424945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.425236 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.425602 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.425602 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.425892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.426044 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.426197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.426355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.426355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.426665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.426901 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.427099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.427252 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.427252 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.427540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.427693 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.427852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.428004 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.428153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855307-1-iscsi {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.428314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.428471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.428622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.428831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.428997 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.429215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.429372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.429372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.429716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.429860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.430049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.430209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.430360 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.430529 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.430682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.430891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.431036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.431187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.431339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.431494 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.431638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.431792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.431953 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.432167 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.432320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.432483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.432632 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.432846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.433006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.433149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.433306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.433450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.433699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.433859 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.433981 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.434094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.434254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.434852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.435035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.435180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.435323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.435465 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.435465 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.435965 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.436118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.436261 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.436414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.436414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.436700 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.436844 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.436998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.437162 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.437304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.437462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.437618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.437763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.437913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.438057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.438057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.438344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.438497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.438647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.438832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.439022 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.439199 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.439483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.439812 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.439985 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.440187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.440349 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.440528 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.440682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.440837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.441007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.441225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.441390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.441568 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.441733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.441877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.442026 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.442174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.442318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.442469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.442620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.442798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.442798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.443088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.443244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.443401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.443543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.443698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.444351 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.444351 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.444351 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.445280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.445426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.445426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.445712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.445885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.446231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.446383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.446383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.446934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.447094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.447247 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.447398 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.447550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.447693 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.447845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.447989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.448146 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.448300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.448451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.448593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.448837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.448984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.449175 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.449341 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.449573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.449735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.449891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.450043 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.450232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.450381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.450525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.450677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.450869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.451015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.451197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.451344 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.451538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.451695 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.451847 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.451997 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.452148 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.452308 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.452452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.452604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.452756 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.452909 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.453099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.453254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.453412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.453595 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.453747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.453895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.454048 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.454048 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.454338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.454483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.455158 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.455314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.455470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.455623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.455781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.455926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.456076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.456416 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.456567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.456567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.456854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.456854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.457131 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.457131 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.457432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.457575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.457717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.457857 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.458014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.458174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.458320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.458463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.458605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.458605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.458914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.459070 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.459220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.459384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.459551 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.459766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.459925 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.460078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.460220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.460418 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.460562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.460705 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.460860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.461011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.461155 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.461305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.461466 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.461618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.461770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.461921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.462071 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.462224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.462373 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.462530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.462673 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.462853 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.462997 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.463139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.463291 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.463454 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.463607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.463758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.463909 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.464060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.464212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.464370 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.464522 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.464674 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.465292 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.465455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.465608 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.465771 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.465929 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.466082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.466236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.466943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:33:57.467207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.467363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.467518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.467671 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.467834 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.467986 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.468138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.468295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.468463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.468606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.468750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.468893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.469043 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.469200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.469352 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.469506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.469658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.469889 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.470047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.470253 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.470445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.470615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.470829 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.470980 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.471123 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.471276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.471419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.471562 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.471713 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.471857 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.472008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.472153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.472303 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.472456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.472606 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.472750 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.472901 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.473046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.473188 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.473329 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.473472 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.473628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.473782 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.473925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.474075 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.474226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.474379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.474530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.474692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.474886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.475542 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.475542 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.475849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.476005 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.476149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.476300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.476445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.476789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.476950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.477192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.477339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.477483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.477637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.477789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.477933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.478098 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.478246 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.478400 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.478544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.478698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.478698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.479050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.479206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.479206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.479206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.479632 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.479784 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.480034 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.480185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.480337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.480523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.480672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.480830 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.480974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.481128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.481270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.481419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.481562 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.481714 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.481856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.482202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.482366 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.482520 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.482664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.482844 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.482999 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.483144 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.483305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.483499 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.483668 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.483821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.483965 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.484106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.484250 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.484392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.484544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.484695 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.484845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.485023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.485277 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.485979 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.486178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.486336 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.486490 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.486633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.486996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.487156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.487312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.487456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.487607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.487759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.487911 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.488070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.488070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.488393 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.489141 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.489305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.489452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.489605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.489757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.489902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.490064 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.490285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.490285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.490614 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.490804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.490962 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.491106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.491248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.491390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.491544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.491694 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.491836 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.491986 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.492129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.492286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.492438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.492582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.492742 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.492884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.493026 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.493184 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.493327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.493477 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.493759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.493931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.494077 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.494229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.494382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.494532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.494684 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.494874 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.495028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.495181 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.495421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.495571 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.496102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.496263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.496419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.496563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.496704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.496848 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.497198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.497357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.497532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.497685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.497838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.497989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.498143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.498294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.498447 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.498593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.498755 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.498917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.499062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.499213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.499376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.499521 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.499665 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.499838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.500115 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.500284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.500518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.500707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.500855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.500999 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.501142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.501295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.501516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.501681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.501825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.501968 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.502118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.502319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.502469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.502620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.502818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.502978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.503123 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.503275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.503426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.503568 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.503721 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.503864 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.504005 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.504156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.504309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.504452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.504593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.504776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.504934 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.505077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.505220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.505362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.505644 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.505644 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.506337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.506490 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.506643 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.506838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.506986 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.507154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.507501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.507654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.507805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.507948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.508109 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.508253 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.508419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.508563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.508706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.508848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.508990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.509214 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.509371 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.509515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.509657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.509799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.509949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.510125 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.510346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.510618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.510861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.511010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.511164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.511317 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.511471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.511623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.511773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.511924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.512067 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.512224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.512377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.512533 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.512685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.512863 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.513021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.513173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.513317 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.513459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.513610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.513760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.513914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.514064 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.514207 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.514356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.514509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.514653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.514904 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.515059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.515204 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.515380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.515567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.515717 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.515869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.516013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.516519 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.516672 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.516816 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.516969 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.517224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.517590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.517759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.517926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.518079 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.518245 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.518397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.518554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.518712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.518888 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.519049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.519227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.519397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.519553 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.519712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.519870 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.520027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.520186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.520362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.520580 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.520822 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.521023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.521182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.521343 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.521513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.521668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.521817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.521817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.522119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.522270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.522436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.522587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.522803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.522962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.523129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.523288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.523438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.523599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.523759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.523925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.524085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.524242 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.524393 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.524555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.524713 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.524863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.525012 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.525162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.525317 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.525484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.525644 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.525802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.525951 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.526143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.526789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.526963 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.527123 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.527275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.527424 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.527770 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.527948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.528102 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.528262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.528432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.528583 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.528740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.528949 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.529113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.529266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.529415 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.529574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.529740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.529904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.530055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.530204 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.530382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.530540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.530818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.531086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.531245 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.531397 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.531547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.531705 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.531866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.532025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.532176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.532333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.532486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.532646 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.532870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.533023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.533188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.533338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.533496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.533656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.533921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.534086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.534086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.534372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.534531 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.534688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.534922 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.535085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.535244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.535408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.535560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.535728 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.535879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.536028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.536184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.536342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.536510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.537010 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.537166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.537166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.537474 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.537626 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.537793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.538126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.538291 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.538449 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.538599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.538792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.538949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.539756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.540474 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.540625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.540793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.541118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.541296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.541456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.541698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.541852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.542002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.542152 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.542300 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.542462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.542620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.542788 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.542945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.543095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.543244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.543407 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.543564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.543725 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.543882 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.544040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.544190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.544347 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.544498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.544656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.544813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.544970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.545129 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.545292 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.545450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.545607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.545769 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.545926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.546090 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.546240 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.546389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.546546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.547048 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.547218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.547384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.547602 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.547786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.547950 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.548331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.548582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.548766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.548927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.548927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.549284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.550418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.550588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.550897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.551262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.551436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.551597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.551757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.551936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.552089 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.552239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.552389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.552539 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.552697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.552697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.553003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.553155 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.553305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.553455 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.553612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.553776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.553938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.554104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.554271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.554430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.554588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.554777 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.554938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.555096 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.555254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.555254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.555547 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.555700 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.555856 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.556024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.556182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.556340 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.556502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.556661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.557185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.557356 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.557517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.557677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.557853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.558027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.558178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.558528 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.558697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.558896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.559058 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.559209 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.559360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.559509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.559666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.559871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.560038 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.560189 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.560347 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.560497 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.560657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.560820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.560971 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.561146 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.561446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.561606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.561766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.561931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.562090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.562241 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.562390 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.562547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.562698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.562956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.563109 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.563259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.563416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.563574 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.563730 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.563890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.564099 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.564251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.564414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.564565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.564728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.564880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.565048 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.565220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.565371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.565602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.565764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.565923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.566082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.566240 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.566392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.566550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.566709 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.567024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.567448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.567631 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.567801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.567969 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.568121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.568271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.568451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.568766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.568930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.569092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.569251 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.569409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.569568 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.569731 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.569881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.570041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.570041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.570335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.570486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.570636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.570825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.570992 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.571144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.571302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.571620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.571777 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.571947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.572108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.572108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.572406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.572558 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.572715 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.572889 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.573052 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.573210 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.573369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.573526 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.573676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.573834 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.574012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.574162 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.574319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.574478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.575263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.575432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.575592 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.575754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.575914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.576074 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.576223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.576383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.576543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.576702 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.576854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.577013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.577281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.577720 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.577876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.578041 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.578202 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.578353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.578513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.578513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.578893 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.579066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.579229 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.579381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.579564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.579731 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.579891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.580051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.580203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.580397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.580579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.580732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.580910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.581069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.581228 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.581440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.581798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.581958 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.582123 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.582282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.582435 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.582592 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.582775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.582933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.583171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.583342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.583500 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.583650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.583808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.583967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.584119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.584269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.584427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.584577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.584735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.584897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.585057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.585209 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.585377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.585555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.585781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.585982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.585982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.586359 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.586556 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.586750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.586953 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.587140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.587510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.587947 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.587947 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.588339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.588536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.588945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.589116 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.589278 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.589437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.589596 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.589756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.589916 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.590074 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.590234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.590398 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.590571 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.590788 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.590971 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.591126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.591284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.591445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.591445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.592270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.592425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.592577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.592737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.592901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.593059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.593231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.593391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.593542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.593693 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.593944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.594116 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.594278 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.594429 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.594579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.594755 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.594912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.595063 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.595329 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.595329 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.595768 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.595768 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.596109 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.596266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.596427 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.596585 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.596752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.596911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.597069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.597228 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.597408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.597720 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.598102 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.598270 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.598423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.598584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.598775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.598944 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.599112 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.599265 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.599416 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.599567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.599726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.599876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.600049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.600200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.600351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.600509 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.600663 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.600812 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.600975 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.601135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.601294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.601453 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.601605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.601763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.601923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.602124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.602280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.602438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.602591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.602773 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.602931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.603091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.603249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.603406 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.603566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.603736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.603736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.604029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.604190 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.604351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.604518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.604689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.604842 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.605001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.605150 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.605303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.605460 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.605619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.605788 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.605962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.606126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.606276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.606439 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.606591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.606808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.606967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.607118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.607118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.607499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.607799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.608160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.608327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.608481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.608643 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.608804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.608958 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.609176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.609340 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.609491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.609642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.609807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.609960 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.610128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.610288 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.610448 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.610614 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.610812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.610812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.611118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.611270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.611420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.611585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.611801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.611960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.611960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.612246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.612397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.612556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.612723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.612887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.613049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.613224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.613379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.613539 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.613698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.613862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.614013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.614166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.614332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.614521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.614684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.614897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.615049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.615210 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.615377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.615544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.615697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.615854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.616004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.616162 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.616323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.616474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.616624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.616774 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.616944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.617115 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.617282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.617440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.617593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.617750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.618270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.618450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.618614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.618795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.618956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.619127 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.619287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.619448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.619609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.619759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.619918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.620068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.620232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.620390 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.620541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.620698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.620849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.620999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.621174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.621333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.621489 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.621489 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.621791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.621941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.622103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.622257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.622414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.622573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.622759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.622928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.623080 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.623249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.623401 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.623552 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.623703 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.623869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.624065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.624217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.624367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.624524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.624676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.624839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.624992 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.625152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.625301 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.625451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.625599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.625766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.625917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.626069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.626219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.626385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.626385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.626791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.626948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.627108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.627277 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.627434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.627605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.627762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.628055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.628428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.628428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.628721 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.628883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.629087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.629240 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.629390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.629540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.629702 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.629871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.630032 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.630190 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.630348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.630498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.630657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.630837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.631000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.631151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.631311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.631311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.631632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.631786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.631936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.632097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.632247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.632398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.632557 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.632726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.633455 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.633619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.633772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.633933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.634098 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.634260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.634418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.634569 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.634765 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.634942 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.635095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.635247 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.635409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.635561 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.635719 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.635880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.636062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.636062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.636359 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.636526 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.636687 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.636855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.637007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.637165 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.637318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.637487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.637650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.637809 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.637961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.638272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.638617 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.638804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.639044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.639200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.639368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.639529 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.639688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.639850 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.640016 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.640174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.640333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.640495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.640659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.640819 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.640970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.641120 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.641280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.641432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.641590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.641758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.641911 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.642112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.642280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.642432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.642599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.642814 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.642982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.643134 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.643292 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.643442 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.643606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.643757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.643915 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.644065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.644222 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.644381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.644546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.644716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.644869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.645019 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.645171 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.645320 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.645481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.645633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.645792 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.645942 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.646091 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.646240 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.646405 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.646556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.646733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.646890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.647051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.647051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.647361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.647532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.647685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.647685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.647984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.648149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.648445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.648804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.648973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.649135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.649297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.649461 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.649636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.649795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.649947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.650104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.650277 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.650428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.650588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.650786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.650957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.651121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.651289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.651448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.651598 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.651747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.651897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.652047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.652212 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.652372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.652524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.652673 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.652823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.652975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.653149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.653309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.653468 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.653618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.653778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.653938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.654090 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.654936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655537 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655622 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655706 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655800 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.655989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656078 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656358 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.656988 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657584 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657872 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.657988 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658089 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658183 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658669 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658815 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658894 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.658976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659058 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659132 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.659945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660016 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660093 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660165 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660235 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660479 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660553 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660696 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.660957 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661116 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661196 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661276 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661350 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661655 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661734 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.661949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662019 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.662921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663020 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663404 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.663987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664075 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664150 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664316 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664398 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664555 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664777 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.664927 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665002 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665080 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665240 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665395 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665608 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665847 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.665927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666470 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666549 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666622 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.666701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667241 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.667956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668404 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668529 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.668989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669222 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669316 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669678 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.669961 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670139 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670738 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.670926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671195 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671475 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671568 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671829 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.671921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672100 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672183 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672541 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672626 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672782 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.672967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.673052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.673136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.673823 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.673960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674171 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.674343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.675672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.676870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:33:57.677602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:33:57.714941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Registered counter for database nova_api Aug 31 04:33:57.729345 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO dbcounter [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Registered counter for database nova_api Aug 31 04:33:57.736011 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:57.742917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:57.749637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_db.sqlalchemy.engines [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:57.756832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writer thread running {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:57.797938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.context [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04318292-e935-4b51-a3d6-6ee7b9045164(cell1) {{(pid=127198) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 04:33:57.802000 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:33:57.802466 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:33:57.804060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:33:57.804770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:33:57.805203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:33:57.807212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:33:57.809236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Registered counter for database nova_cell0 Aug 31 04:33:57.811759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.context [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04318292-e935-4b51-a3d6-6ee7b9045164(cell1) {{(pid=127197) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 04:33:57.813291 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Registered counter for database nova_cell1 Aug 31 04:33:57.815837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:33:57.816378 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:33:57.817834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:33:57.818545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:33:57.819006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:33:57.820882 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:57.821054 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:33:57.822379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:57.823218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO dbcounter [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Registered counter for database nova_cell0 Aug 31 04:33:57.827274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO dbcounter [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Registered counter for database nova_cell1 Aug 31 04:33:57.830298 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:57.830603 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:57.834548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_db.sqlalchemy.engines [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:57.838990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_db.sqlalchemy.engines [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:57.840532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writer thread running {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:57.977168 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Registered counter for database nova_cell0 Aug 31 04:33:57.982689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writer thread running {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:57.987590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:57.992510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:57.992637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO dbcounter [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Registered counter for database nova_cell0 Aug 31 04:33:57.999451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_db.sqlalchemy.engines [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:33:58.004908 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writer thread running {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:33:58.311758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:33:58.319294 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:33:58.332455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: WARNING keystonemiddleware.auth_token [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:33:58.339832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: WARNING keystonemiddleware.auth_token [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:33:58.668630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:33:58.674746 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-b2dfab8f-e547-4b28-a1a6-35165d212bf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:33:58.680022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7a7b999c0 pid: 127198 (default app) Aug 31 04:33:58.709460 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: WARNING keystonemiddleware.auth_token [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:33:58.714974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: WARNING keystonemiddleware.auth_token [None req-23670dd3-2a2d-4ead-a794-90f12d219249 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:33:58.720716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7a7b999c0 pid: 127197 (default app) Aug 31 04:34:44.944254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:44.945351 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:44.946181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:44.946963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:46.248503 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1156515208", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "networks": [{"uuid": "7c94b017-0418-451b-8f43-772814075ce1"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:34:47.315917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] validate_networks() for [('7c94b017-0418-451b-8f43-772814075ce1', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:34:50.200658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:34:50.201345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:34:50.201578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:34:50.201944 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:34:50.203011 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:34:50.250384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:50.259521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:50.259983 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:50.260794 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:50.261249 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:50.261670 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:50.424296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Getting quotas for project 2967ca7d73584b45baa158f5994f64df. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:34:50.460868 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Getting quotas for user 0f863757bba840ea85db119179b9fc7c and project 2967ca7d73584b45baa158f5994f64df. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:34:50.513627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:34:50.526148 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:34:50.756452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-06c22800-2127-4521-b207-d1054b5c62e9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.840317 Aug 31 04:34:50.763972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 5849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:34:50.778413 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:50.779920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:50.781255 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:50.786072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:51.476462 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a4ff548f-61c5-4195-8f7d-086bafd2b165 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:34:51.477783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a4ff548f-61c5-4195-8f7d-086bafd2b165 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:34:51.655527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6956a38e-f97d-48a5-8c2f-58ca3c62f644 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'create', calling method: .version_select at 0x7fc8275b1ca0>, body: {"keypair": {"name": "tempest-keypair-1520384366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYgRhvTx+R3fDYOvQUHbrgjKRUwA0lThTqEZm/umfnuUHyitTvFCNdqSoRHIYkgFLg3xZk1GmBUb/KMMoE3W9vSnmncFRDaKqLrlZKt9Vcks3QYktwk6KDYqhaUDDNEtA=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:34:51.788791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-6956a38e-f97d-48a5-8c2f-58ca3c62f644 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:34:51.797482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-6956a38e-f97d-48a5-8c2f-58ca3c62f644 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for user 13ac62bdb9bc4c7f94dad08f810559e9 and project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:34:51.945335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6956a38e-f97d-48a5-8c2f-58ca3c62f644 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.005080 Aug 31 04:34:51.946271 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 2/2] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Aug 31 04:34:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1008 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 04:34:52.435424 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-344167186", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:34:52.550540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] validate_networks() for [('2813bab1-8e5c-4bae-a18b-804fcb1fb44c', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:34:52.731507 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a4ff548f-61c5-4195-8f7d-086bafd2b165 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:34:52.766417 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a4ff548f-61c5-4195-8f7d-086bafd2b165 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1215 microversion: 2.1 time: 1.982539 Aug 31 04:34:52.783078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:34:50 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1215 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:34:53.790498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:34:53.791231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:34:53.805867 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:53.806627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:53.807218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:53.808443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:53.809154 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:53.809735 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:54.091072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:34:54.109573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-81765681-91fa-4f26-84ba-e3d2d0f22351 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1211 microversion: 2.1 time: 0.323021 Aug 31 04:34:54.110077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:34:53 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1211 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:34:54.270425 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4acd8f25-8612-454c-a409-eedf2012c77c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'create', calling method: .version_select at 0x7fc827ddfc10>, body: {"keypair": {"name": "tempest-keypair-2143802921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI22eToLmRoLlpGMOH+pphYsyV6A/BTRyL0MTO1Bwj1mh2JR8UBRu0F/uDxEwFJpDXAxXWnxMXh5pT+Xy+4pwEdcZEIdpqNk0xPXlsWwPKy/SxRWRiZWw+YOtwKDtfQWvw=="}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:34:54.327197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-4acd8f25-8612-454c-a409-eedf2012c77c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:34:54.340390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-4acd8f25-8612-454c-a409-eedf2012c77c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for user 718418f954f94dad93eeb725e345c850 and project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:34:54.357369 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:34:54.358733 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:34:54.359413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:34:54.360061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:34:54.360611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:34:54.377648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:54.378127 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:54.378548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:54.379285 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:54.379723 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:54.384034 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:54.426640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for project c02e60929267489cb181831f1ac578e4. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:34:54.441783 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for user 863e457bd6fd4bff82f552e63ca1034c and project c02e60929267489cb181831f1ac578e4. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:34:54.457874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:34:54.460159 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:34:54.466749 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4acd8f25-8612-454c-a409-eedf2012c77c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.355542 Aug 31 04:34:54.467420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 3/5] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:34:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:34:54.596732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e14e2239-8cd1-40df-a4f1-bbd5ec4e5ec9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.482972 Aug 31 04:34:54.604241 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 3/6] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:34:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:34:54.610275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-afc44d7a-521a-41d2-8d29-2c40e8447772 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:34:54.611127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-afc44d7a-521a-41d2-8d29-2c40e8447772 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:34:55.043391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-afc44d7a-521a-41d2-8d29-2c40e8447772 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:34:55.053427 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-afc44d7a-521a-41d2-8d29-2c40e8447772 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1221 microversion: 2.1 time: 0.447075 Aug 31 04:34:55.060078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:34:54 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1221 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:34:55.133805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:34:55.134495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:34:55.176551 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:55.182640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:55.183351 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:55.184405 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:55.185191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:55.185927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:55.362504 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1671542069", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:34:55.689315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] validate_networks() for [('2813bab1-8e5c-4bae-a18b-804fcb1fb44c', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:34:56.397502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:34:56.455274 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f6b309c-1e01-47ff-b06d-91203efb63c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1273 microversion: 2.1 time: 1.324384 Aug 31 04:34:56.455880 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:34:55 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1273 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:34:57.477896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:34:57.479805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:34:57.498314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:57.502459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:57.524892 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:57.529409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:57.530396 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:57.534645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:57.733942 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:34:57.777091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d78051a5-4adf-410c-8d14-a9f18fa7a5b7 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1273 microversion: 2.1 time: 0.304700 Aug 31 04:34:57.785429 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:34:57 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:34:58.806958 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:34:58.808515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:34:58.821376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:58.822022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:58.822673 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:58.825767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:58.826890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:58.827331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:59.149446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:34:59.151407 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:34:59.164080 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:34:59.167538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:34:59.174946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:34:59.217821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:59.219723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:59.220404 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:59.221693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:34:59.223483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:34:59.228961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:34:59.300481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for project c02e60929267489cb181831f1ac578e4. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:34:59.310108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for user 863e457bd6fd4bff82f552e63ca1034c and project c02e60929267489cb181831f1ac578e4. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:34:59.384417 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:34:59.391621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:34:59.796628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-61f392ff-e0cb-49ab-808a-e247efdabc32 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.439521 Aug 31 04:34:59.797299 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 5/10] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:34:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 4441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 04:34:59.878584 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-70b8bacf-6c1a-46d6-afb5-3961813f022f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:34:59.879288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-70b8bacf-6c1a-46d6-afb5-3961813f022f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:34:59.948069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:34:59.964358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b3f260e-cf7f-4b94-8295-c954c6157d5b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 1.162235 Aug 31 04:34:59.966133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:34:58 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:00.302046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-70b8bacf-6c1a-46d6-afb5-3961813f022f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:00.312742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-70b8bacf-6c1a-46d6-afb5-3961813f022f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1222 microversion: 2.1 time: 0.502276 Aug 31 04:35:00.313762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:34:59 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1222 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:00.432782 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1961621745", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31592010-3eea-4675-990e-8bd640d060b2"}], "security_groups": [{"name": "tempest-securitygroup--204863759"}], "key_name": "tempest-keypair-1520384366", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:00.765047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] validate_networks() for [('31592010-3eea-4675-990e-8bd640d060b2', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:35:00.999824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:01.000692 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:01.036221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:01.040785 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:01.045293 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:01.062920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:01.064847 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:01.065557 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:01.715028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:01.745875 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-09de0734-414b-4263-b8d3-cf05438b87a1 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.749952 Aug 31 04:35:01.760998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:00 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:01.788112 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:01.790973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:01.815967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:01.819331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:01.823616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:01.827818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:01.828618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:01.829541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:02.005957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:02.020438 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-efac43f5-d642-4b50-9117-e98f69c6ac6f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1218 microversion: 2.1 time: 0.265005 Aug 31 04:35:02.022669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:01 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1218 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:02.030162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-446698623", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4d0d7af-fefb-4895-aa58-44d019a740ec"}], "security_groups": [{"name": "tempest-securitygroup--610828321"}], "key_name": "tempest-keypair-2143802921", "user_data": "}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:02.231840 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] validate_networks() for [('e4d0d7af-fefb-4895-aa58-44d019a740ec', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:35:03.118630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:35:03.119877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:35:03.121055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:35:03.121776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:35:03.122391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:35:03.128171 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:35:03.129208 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:35:03.129874 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:35:03.130622 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:35:03.131558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:35:03.138694 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.139486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.140271 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.141249 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.141895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.142529 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.144621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.145205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.145744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.147468 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.148139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.149722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.166353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:35:03.172867 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for user 13ac62bdb9bc4c7f94dad08f810559e9 and project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:35:03.199081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:35:03.203776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:35:03.210542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:35:03.223382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for user 718418f954f94dad93eeb725e345c850 and project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:35:03.268171 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:35:03.275370 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:35:03.350091 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b81a2a6e-6779-4f5a-9623-a6a0dc517da2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.324025 Aug 31 04:35:03.351382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 9/15] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:35:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:35:03.354808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a9e8bdbf-263a-4c24-9fd8-1beff1062060 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.927266 Aug 31 04:35:03.359016 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 7/16] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 31 04:35:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 04:35:03.359399 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:03.360572 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:03.381159 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.382143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.382483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.383475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.384002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.387303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.415785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:03.416406 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:03.450501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.452302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.452823 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.454595 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:03.456800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:03.457913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:03.662250 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:03.677849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c36c2514-0724-401a-b6ff-14a7ec220970 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.318448 Aug 31 04:35:03.679925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:03 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:03.694763 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2b5c6ad5-5e5e-492f-9745-2f379f300200 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:03.695881 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2b5c6ad5-5e5e-492f-9745-2f379f300200 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:03.722421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:03.746430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fd99d802-6fb2-4ba1-be57-d39dad57ba44 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1274 microversion: 2.1 time: 0.383013 Aug 31 04:35:03.750327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 8/18] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:03 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1274 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:03.767989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-18a01cdd-0b6d-4e5d-96ad-687b682e0148 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:03.768536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-18a01cdd-0b6d-4e5d-96ad-687b682e0148 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:03.857887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2b5c6ad5-5e5e-492f-9745-2f379f300200 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:03.870690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2b5c6ad5-5e5e-492f-9745-2f379f300200 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1237 microversion: 2.1 time: 0.187343 Aug 31 04:35:03.873453 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:03 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1237 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:03.972469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18a01cdd-0b6d-4e5d-96ad-687b682e0148 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:03.998350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18a01cdd-0b6d-4e5d-96ad-687b682e0148 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:03.999817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18a01cdd-0b6d-4e5d-96ad-687b682e0148 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:04.000918 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-18a01cdd-0b6d-4e5d-96ad-687b682e0148 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1282 microversion: 2.20 time: 0.249599 Aug 31 04:35:04.007168 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 9/20] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:03 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:04.483941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-20bf925d-15a7-400b-a5b1-13b424d1c71a req-6ec52499-d95b-4c1a-a905-c6e79d67863f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4342bb06-528a-4fff-8494-cfbce3babb99", "tag": "5e5c2be7-aa12-4c15-87d9-6d00c7cc9777"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:04.499004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-20bf925d-15a7-400b-a5b1-13b424d1c71a req-6ec52499-d95b-4c1a-a905-c6e79d67863f service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:04.499569 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-20bf925d-15a7-400b-a5b1-13b424d1c71a req-6ec52499-d95b-4c1a-a905-c6e79d67863f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:04.500199 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-20bf925d-15a7-400b-a5b1-13b424d1c71a req-6ec52499-d95b-4c1a-a905-c6e79d67863f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:04.525934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-20bf925d-15a7-400b-a5b1-13b424d1c71a req-6ec52499-d95b-4c1a-a905-c6e79d67863f service nova] Creating event network-changed:5e5c2be7-aa12-4c15-87d9-6d00c7cc9777 for instance 4342bb06-528a-4fff-8494-cfbce3babb99 on hv-cinder-85530 Aug 31 04:35:04.526696 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-20bf925d-15a7-400b-a5b1-13b424d1c71a req-6ec52499-d95b-4c1a-a905-c6e79d67863f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 04:35:04.527271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-20bf925d-15a7-400b-a5b1-13b424d1c71a req-6ec52499-d95b-4c1a-a905-c6e79d67863f service nova] Acquired lock "compute-rpcapi-router" {{(pid=127197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 04:35:04.528987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:04.529658 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:04.530208 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:04.531123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:04.531714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:04.532275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:04.545481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.compute.rpcapi [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 04:35:04.546653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] Releasing lock "compute-rpcapi-router" {{(pid=127197) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 04:35:04.567471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a8bbaa8e-df8b-4d9c-b001-6863c4fe3a4b None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151946 Aug 31 04:35:04.569803 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 12/21] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:04.709587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:04.711324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:04.718645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:04.719843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:04.720468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:04.722754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:04.723420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:04.724070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:04.779182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:04.779975 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:04.802267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:04.802267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:04.802267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:04.802267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:04.802618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:04.802618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:04.928703 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:04.941601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-21625e91-f468-499c-98f9-a1790f869a6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.240611 Aug 31 04:35:04.942829 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 10/22] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:04 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:04.977299 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-91e1b2af-ccde-4274-9b46-e4cd16023d04 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:04.977920 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-91e1b2af-ccde-4274-9b46-e4cd16023d04 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:05.029022 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:05.100169 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6928ae30-9cf0-4152-9661-b1d9d4766fd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1274 microversion: 2.1 time: 0.323130 Aug 31 04:35:05.102035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 13/23] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:04 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:05.108504 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:05.109374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:05.121993 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:05.122672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:05.123427 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:05.124509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:05.125184 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:05.126176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:05.160355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-91e1b2af-ccde-4274-9b46-e4cd16023d04 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:05.168519 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-91e1b2af-ccde-4274-9b46-e4cd16023d04 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1237 microversion: 2.1 time: 0.224551 Aug 31 04:35:05.171574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:04 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1237 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:05.227520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:05.239786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:05.244037 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:05.245590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c83b38a3-cd9b-4f19-bb35-e604f4bbc054 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1286 microversion: 2.20 time: 0.142330 Aug 31 04:35:05.246569 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 14/25] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:05 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:05.962383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:05.964222 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:05.976327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:05.977422 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:05.980197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:05.981142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:05.981734 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:05.986408 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:06.122382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:06.125703 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:06.134703 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:06.135636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:06.136270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:06.137349 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:06.138179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:06.138809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:06.376969 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:06.394336 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-317aab51-ebb2-402c-9b0b-4507c2da703e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1274 microversion: 2.1 time: 0.276082 Aug 31 04:35:06.396702 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 15/26] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:06 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1274 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:06.404844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:06.409055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:06.427154 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:06.428234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:06.431087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:06.432239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:06.432885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:06.434387 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:06.584898 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:06.604330 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e9f113a6-068a-48ad-9236-38911e3e250d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1233 microversion: 2.1 time: 0.200207 Aug 31 04:35:06.609047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 16/27] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:06 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1233 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:06.614302 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:06.619805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:06.656114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:06.664950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:06.666485 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:06.675619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:06.676412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:06.677524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:06.882706 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:06.893394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c3679334-ac2b-41a6-8f17-d2a3588f0504 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.934995 Aug 31 04:35:06.902316 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 12/28] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:05 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:07.162297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:07.171381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:07.182305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:07.183903 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-dbcc5586-a7bd-4e21-93b6-14f871a3ef84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1278 microversion: 2.20 time: 0.573359 Aug 31 04:35:07.184946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 17/29] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:06 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1278 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:07.416631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:07.418253 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:07.432003 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:07.437473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:07.438563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:07.439841 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:07.442535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:07.445662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:07.644890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:07.646277 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:07.705083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:07.708075 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:07.715267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:07.720296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:07.734263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:07.739380 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:07.916831 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:07.925699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a3be990c-307f-4ae1-8073-26865ced8617 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1280 microversion: 2.1 time: 0.513635 Aug 31 04:35:07.926271 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 13/30] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:07 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1280 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:07.965619 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:07.968832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:07.987781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:07.991544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:07.996444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:07.998349 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:07.999213 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:08.001368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:08.076080 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:08.101749 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2b10a558-6ebe-4d9e-aaa5-fa9bdeecbd39 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1289 microversion: 2.1 time: 0.471659 Aug 31 04:35:08.107182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 18/31] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:07 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1289 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:08.209737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:08.210450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:08.217361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:08.224819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:08.225441 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:08.229521 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:08.229996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:08.230422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:08.393634 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:08.402899 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c268e8b5-733a-453f-836b-8cd58aaa8fd9 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.464943 Aug 31 04:35:08.420207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 14/32] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:07 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:08.473353 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:08.483500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:08.512991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:08.517270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-50602f48-6f96-49f7-bf54-1c76639d6fe4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1334 microversion: 2.20 time: 0.314030 Aug 31 04:35:08.543592 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 19/33] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:08 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1334 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:08.946343 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:08.947070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:08.956487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:08.959588 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:08.960189 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:08.961082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:08.963383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:08.963971 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:09.129719 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:09.130414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:09.148256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:09.154433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:09.155488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:09.156267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:09.156712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:09.163006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:09.362354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:09.380185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-23633bca-1625-4dac-b900-f10296bbf1c9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1280 microversion: 2.1 time: 0.437953 Aug 31 04:35:09.385453 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:08 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1280 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:09.428964 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:09.430081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:09.448400 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:09.450117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:09.452449 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:09.458541 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:09.460245 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:09.464559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:09.578019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:09.597077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b1f49189-4ac0-4f74-844b-91d3a7a36570 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1297 microversion: 2.1 time: 0.472588 Aug 31 04:35:09.612117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 20/35] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:09 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1297 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:09.617884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:09.618500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:09.633038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:09.633778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:09.634341 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:09.635402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:09.636119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:09.636835 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:09.777279 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:09.794515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:09.818837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:09.830917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-900d6c35-ae1e-4c16-8fbf-08369d4c00ce tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1334 microversion: 2.20 time: 0.217396 Aug 31 04:35:09.842742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 21/36] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:09 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1334 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:10.333406 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:10.342338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1448d09d-66c4-4739-9759-59e3e381fc49 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.918123 Aug 31 04:35:10.345705 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 16/37] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:09 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:10.405699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:10.406388 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:10.416994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:10.417793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:10.419836 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:10.421388 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:10.421865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:10.422271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:10.618871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:10.619483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:10.627154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:10.627651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:10.628075 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:10.628777 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:10.629219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:10.636214 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:10.713765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:10.723673 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:10.727889 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-33427342-0810-4438-b2ec-94d4b2489bf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.326904 Aug 31 04:35:10.738776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 22/38] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:10 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:10.739180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6aac2f4d-69f7-47d6-8661-0dd249060f77 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1297 microversion: 2.1 time: 0.122391 Aug 31 04:35:10.739717 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 17/39] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:10 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:10.853964 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:10.854564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:10.865297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:10.867761 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:10.871046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:10.871825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:10.872213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:10.872620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:10.961260 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-d617b579-7cce-41bf-9145-e1090f7bd166 req-62782c32-7541-487a-87c5-10610713cff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaed2599-c3cc-4ac7-91be-29c314bf23cb", "tag": "d3c77a9f-10ad-42fc-ba35-41e7e28b3832"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:10.971174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:10.981036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:10.982459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:10.983758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-46af51d8-4948-40fb-a7be-ce5568152839 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1334 microversion: 2.20 time: 0.134208 Aug 31 04:35:10.984312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 23/40] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:10 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:10.984973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d617b579-7cce-41bf-9145-e1090f7bd166 req-62782c32-7541-487a-87c5-10610713cff4 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:10.986196 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d617b579-7cce-41bf-9145-e1090f7bd166 req-62782c32-7541-487a-87c5-10610713cff4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:10.986909 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d617b579-7cce-41bf-9145-e1090f7bd166 req-62782c32-7541-487a-87c5-10610713cff4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.024670 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d617b579-7cce-41bf-9145-e1090f7bd166 req-62782c32-7541-487a-87c5-10610713cff4 service nova] Creating event network-changed:d3c77a9f-10ad-42fc-ba35-41e7e28b3832 for instance aaed2599-c3cc-4ac7-91be-29c314bf23cb on hv-cinder-85530 Aug 31 04:35:11.025218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d617b579-7cce-41bf-9145-e1090f7bd166 req-62782c32-7541-487a-87c5-10610713cff4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 04:35:11.025867 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d617b579-7cce-41bf-9145-e1090f7bd166 req-62782c32-7541-487a-87c5-10610713cff4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 04:35:11.026963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.027415 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.027832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.028572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.029180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.029575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.041894 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.compute.rpcapi [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 04:35:11.042795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 04:35:11.059984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-78f7d36e-2b33-4e8f-814e-7d5162a010d4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102508 Aug 31 04:35:11.061235 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 18/41] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:35:11.368439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:11.369430 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:11.379532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.380307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.381001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.381908 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.382335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.382755 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.386825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:11.514572 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:11.526851 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8c5e8abe-45f3-483c-8742-8546c80f9ce5 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.165235 Aug 31 04:35:11.527662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 24/42] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:11 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:11.772444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:11.773036 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:11.780280 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.780754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.782238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.782337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:11.782781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.782860 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:11.782927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.782927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.789847 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.790335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.790784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.791483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:11.791927 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:11.792344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:11.862924 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:11.877813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c10aac88-958e-4ecf-a420-056d65f13d2d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1307 microversion: 2.1 time: 0.099958 Aug 31 04:35:11.878404 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:11 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:11.938346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:11.947421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ace52a48-2ec3-4fa4-85fb-8809fab1a2fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.181152 Aug 31 04:35:11.948076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 19/44] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:11 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:12.008207 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:12.009014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:12.012685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:12.018378 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.019071 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.019683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:12.020765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.021289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.021913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:12.084551 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:12.092990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:12.094832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:12.095943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1d1ed265-e1f9-404a-a7a2-5e44f1dabe08 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1334 microversion: 2.20 time: 0.094313 Aug 31 04:35:12.096499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 26/45] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:12 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:12.552659 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:12.553317 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:12.559744 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.560216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.560646 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:12.561307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.561750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.562159 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:12.705364 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:12.713641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b4426662-49bf-4c6e-805f-d1270262672c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.165130 Aug 31 04:35:12.714186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 20/46] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:12 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:12.900878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:12.902196 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:12.909113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.909878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.910503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:12.911433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.912077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.912775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:12.968434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:12.970083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:12.974063 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:12.980907 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.981797 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.984681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:12.985730 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:12.986677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:12.987348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:12.988173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:13.005707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-40ded041-9833-481b-97c5-99fd2ee71ce8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1307 microversion: 2.1 time: 0.108794 Aug 31 04:35:13.006928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 27/47] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:12 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:13.119578 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:13.120289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:13.131198 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:13.131530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:13.132628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:13.133346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:13.133794 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:13.134242 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:13.167762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:13.187802 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e5b64d2b-7647-4e7b-935e-372b5fdf35ba tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.223548 Aug 31 04:35:13.188623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:12 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:13.216500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:13.226677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:13.228288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:13.230193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-52272ca1-aedd-42dd-89cc-d44e6199b113 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1342 microversion: 2.20 time: 0.114487 Aug 31 04:35:13.230193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 28/49] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:13 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1342 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:13.735488 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:13.736091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:13.744004 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:13.744812 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:13.745439 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:13.746649 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:13.747375 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:13.748027 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:13.887447 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:13.891129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:13.904935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1c00bcc0-cc7b-4d81-90d4-6d33be9fb6fa tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.173337 Aug 31 04:35:13.905522 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 22/50] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:13 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:14.028175 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:14.028986 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:14.038020 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=24 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:14.042638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.043135 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.043704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:14.044563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.045194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.045752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:14.159191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:14.171119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-adf8a344-306f-4fde-8fbd-8d8cef0d9054 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1307 microversion: 2.1 time: 0.146603 Aug 31 04:35:14.177941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 29/51] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:14 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:14.213559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:14.214960 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:14.225179 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.226417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.227217 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:14.228678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.229914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.230886 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:14.254162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:14.255121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:14.275262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.276013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.276820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:14.278812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.279511 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.281813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:14.364126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:14.375408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:14.377268 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:14.378503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7a5f4851-f6fe-415f-a983-9d852c307a67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1342 microversion: 2.20 time: 0.128961 Aug 31 04:35:14.379160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 30/52] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:14 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1342 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:14.425903 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:14.438433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-473d5d99-a547-437c-ba65-3196a2b103e1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.228732 Aug 31 04:35:14.439146 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 23/53] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:14 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:14.928045 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:14.928911 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:14.939224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=6 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:14.946452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.947235 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.947794 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:14.948646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:14.949086 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:14.949526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:15.113571 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:15.121450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3c1dc3d0-c913-46a2-8902-21f0359c4f02 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.197238 Aug 31 04:35:15.122016 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 31/54] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:14 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:15.199194 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:15.200048 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:15.201973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=26 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:15.207104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:15.213973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:15.215223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:15.216286 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:15.216924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:15.217645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:15.355442 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:15.371953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e7500a73-7eef-49df-843b-bcba308ed252 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1307 microversion: 2.1 time: 0.175871 Aug 31 04:35:15.373732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 24/55] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:15 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:15.403702 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:15.404315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:15.414704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:15.421748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:15.422350 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:15.424637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:15.425108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:15.426955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:15.466628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:15.467304 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:15.485374 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:15.488727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:15.489203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:15.495652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:15.496131 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:15.496555 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:15.811561 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:15.822830 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:15.824524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:15.825990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0f0b7533-1cd1-4df1-b6d7-b88a6c4d315d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1342 microversion: 2.20 time: 0.428847 Aug 31 04:35:15.827734 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 32/56] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:15 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1342 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:15.952570 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:15.966381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9e24132e-9864-4115-b200-06c494800d9c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.506412 Aug 31 04:35:15.987576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 25/57] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:15 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:16.144070 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:16.145361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:16.151713 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.157100 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.157693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:16.159775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.160875 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.160875 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:16.335827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:16.343629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bb3d302e-be0f-49e5-b3d6-fe183f8840c4 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.203917 Aug 31 04:35:16.344088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 33/58] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:16 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:16.393490 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:16.394104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:16.400462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.400938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.401362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:16.402055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.402481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.402935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:16.472814 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:16.480654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ef8fdc11-77c9-49a0-bada-49e7e10d3e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1307 microversion: 2.1 time: 0.091056 Aug 31 04:35:16.481434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 26/59] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:16 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:16.851000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:16.851602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:16.858206 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.858686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.859141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:16.859831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.860276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.860693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:16.923464 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:16.932582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:16.933823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:16.934976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6fa1dc7c-bad6-4e90-ac96-256cf8d7105d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1342 microversion: 2.20 time: 0.089219 Aug 31 04:35:16.935532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 34/60] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:16 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:16.988937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:16.989573 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:16.996062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.996566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.996982 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:16.997642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:16.998074 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:16.998482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:17.146129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:17.154248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4cfd40fd-6e32-4531-b464-edf21c0e8ded tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.169015 Aug 31 04:35:17.154795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 27/61] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:16 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:17.365817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:17.366421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:17.372869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:17.373356 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:17.373948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:17.374797 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:17.375231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:17.375825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:17.501099 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:17.501743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:17.513732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:17.514459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:17.515011 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:17.515438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:17.519660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6027f671-9282-4894-b6ca-cdeff7349ddd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.158074 Aug 31 04:35:17.520220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 35/62] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:17 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:17.520902 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:17.521513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:17.521938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:17.584900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:17.592750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a8792a73-9807-464d-a524-1bd79b40d480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1307 microversion: 2.1 time: 0.095733 Aug 31 04:35:17.593294 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 28/63] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:17 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:17.957192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:17.958161 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:17.965611 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:17.966424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:17.966880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:17.967560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:17.968380 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:17.968547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:18.034844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:18.043249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:18.044665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:18.045792 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7f579578-87bc-42cd-81c1-e8ef877d8c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1342 microversion: 2.20 time: 0.092582 Aug 31 04:35:18.050870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 36/64] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:17 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1342 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:18.175573 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:18.176169 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:18.182219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:18.182690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:18.183138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:18.183810 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:18.184257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:18.184649 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:18.316551 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:18.324784 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4f43bdf5-0299-4dd6-a6e3-d4cc873b622f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.152972 Aug 31 04:35:18.325815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 29/65] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:18 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:18.539891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:18.540710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:18.546820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:18.547296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:18.547775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:18.548497 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:18.548943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:18.549410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:18.613311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:18.614654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:18.621375 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:18.622123 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:18.622563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:18.623754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:18.624250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:18.624693 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:18.686623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:18.691015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:18.695018 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f33eded1-01e0-468c-a3b5-bf29e8cf9f5d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.159116 Aug 31 04:35:18.695591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 37/66] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:18 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:18.711041 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f7c5e4e3-d59b-4fd4-a3f6-c5c2d2972bd0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1307 microversion: 2.1 time: 0.101427 Aug 31 04:35:18.711612 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 30/67] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:18 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:19.079884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:19.080461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:19.089143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.089638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.090068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.090812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.091264 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.091682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.165648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:19.174959 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:19.176421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:19.177528 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d0ae99a5-cebf-430d-a120-54a3de6207b5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1342 microversion: 2.20 time: 0.101714 Aug 31 04:35:19.178081 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 38/68] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:19 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:19.345926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:19.346535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:19.353407 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.354188 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.354870 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.355798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.356516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.357485 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.715955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:19.717262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:19.724355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.725376 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.725885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.726834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.727827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.728007 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:19.729003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.736833 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d8ffdd93-4ef5-4617-9c91-5740c8297fca tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.395011 Aug 31 04:35:19.737514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 31/69] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:19 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:19.753559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:19.754160 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:19.760354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.760829 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.761254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.761930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:19.762387 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:19.762822 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:19.824019 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:19.831578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d5ce068c-03f8-4c64-a1e2-eb5028e3577a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1295 microversion: 2.1 time: 0.093312 Aug 31 04:35:19.832136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 32/70] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:19 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:19.933586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:19.941279 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e68f7b3f-af04-420a-8846-312b2ee6c642 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.229344 Aug 31 04:35:19.941818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 39/71] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:19 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:20.182997 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-ba678159-e352-4d85-83f0-09649c294c03 req-d9e314d3-107a-4252-89be-ac4555c81e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43", "tag": "c124b064-1e1f-4174-96ce-6515e6731abc"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:20.192782 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ba678159-e352-4d85-83f0-09649c294c03 req-d9e314d3-107a-4252-89be-ac4555c81e45 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.193245 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ba678159-e352-4d85-83f0-09649c294c03 req-d9e314d3-107a-4252-89be-ac4555c81e45 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.193681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ba678159-e352-4d85-83f0-09649c294c03 req-d9e314d3-107a-4252-89be-ac4555c81e45 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.199570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:20.200168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:20.205060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-ba678159-e352-4d85-83f0-09649c294c03 req-d9e314d3-107a-4252-89be-ac4555c81e45 service nova] Creating event network-changed:c124b064-1e1f-4174-96ce-6515e6731abc for instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 on hv-cinder-85530 Aug 31 04:35:20.205944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.206410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.206862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.207544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.208862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.209287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.210372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-ba678159-e352-4d85-83f0-09649c294c03 req-d9e314d3-107a-4252-89be-ac4555c81e45 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087004 Aug 31 04:35:20.211120 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 33/72] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:20.271511 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:20.275402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:20.280967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:20.282396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:20.283535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-17c94ffe-78d5-4427-ba33-510dcfac457e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1340 microversion: 2.20 time: 0.087897 Aug 31 04:35:20.284073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 40/73] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:20 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:20.761920 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:20.763084 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:20.772743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.773395 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.773820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.774502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.774968 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.775387 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.852831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:20.853458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:20.860215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.860689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.861114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.861796 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.862228 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.862639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.916933 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:20.924706 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-958c52dd-9b62-42fe-9c79-34c7272ff960 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.169670 Aug 31 04:35:20.925278 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 34/74] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:20 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:20.926835 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:20.935427 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5a859dcd-ea68-4b6e-9986-88fac62b7fc3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1295 microversion: 2.1 time: 0.086681 Aug 31 04:35:20.935957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 41/75] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:20 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:20.962352 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:20.962994 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:20.969116 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.969955 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.970377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:20.971080 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:20.971519 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:20.971930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:21.040425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:21.113166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:21.121747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d268dd64-f602-4d9d-96cc-87296a47badb tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.163481 Aug 31 04:35:21.122313 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 35/76] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:20 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:21.310424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:21.311400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:21.320235 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:21.320717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:21.321145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:21.321819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:21.322263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:21.322676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:21.385948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:21.394474 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:21.395948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:21.397054 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6bd43a2a-98ff-4ca0-8f18-22ca4dd1b1ab tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1340 microversion: 2.20 time: 0.094144 Aug 31 04:35:21.397888 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 42/77] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:21 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1340 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:21.948687 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:21.949477 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:21.957923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:21.958552 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:21.959160 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:21.960059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:21.960622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:21.961198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:21.963230 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:21.964051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:21.972757 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:21.973388 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:21.973943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:21.974879 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:21.975607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:21.976027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:22.039678 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:22.047438 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-579a38a5-f5ef-4806-8408-15364fba2b17 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1295 microversion: 2.1 time: 0.089269 Aug 31 04:35:22.048018 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 43/78] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:21 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:22.092865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:22.100906 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7ae8f38d-3ed1-4a44-9c45-90a7bd87008c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.157769 Aug 31 04:35:22.101437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 36/79] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:21 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:22.146238 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:22.147021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:22.156221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:22.156933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:22.157494 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:22.158553 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:22.159205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:22.159779 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:22.289280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:22.297009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-42909ce6-0611-48a6-a105-c444f105f5bc tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.156872 Aug 31 04:35:22.297591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 44/80] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:22 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:22.419866 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:22.420458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:22.427566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:22.428033 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:22.428465 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:22.429416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:22.429844 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:22.430335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:22.634899 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:22.644536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:22.646084 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:22.648588 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-18379421-c5b8-462b-8c26-180fc015372a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1340 microversion: 2.20 time: 0.232657 Aug 31 04:35:22.650467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 37/81] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:22 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1340 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:23.069977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:23.071332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:23.081132 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.081616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.082003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.083223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.084365 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.084967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.122097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:23.123092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:23.129878 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.130507 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.131062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.131890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.132861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.133749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.218644 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:23.227039 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bc91d745-3ac4-4bea-917c-416f323087ca tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1295 microversion: 2.1 time: 0.162145 Aug 31 04:35:23.227616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 45/82] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:23 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:23.322263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:23.323439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:23.334017 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.334516 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.336070 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.339580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.343627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.360777 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.514905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:23.526444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b7073945-75f8-45b6-90c0-baaec16512f8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.407937 Aug 31 04:35:23.527524 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 38/83] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:23 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:23.601168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:23.609866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d24031d1-36a8-4c93-85c3-551702120e2a tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.292644 Aug 31 04:35:23.610746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 46/84] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:23 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:23.680769 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:23.681602 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:23.689183 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.690029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.690669 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.691857 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:23.698247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:23.698701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:23.790595 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:23.801972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:23.806416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:23.808849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-66af5620-4129-4ceb-a116-189e5de1fb36 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1340 microversion: 2.20 time: 0.134114 Aug 31 04:35:23.813136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 39/85] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:23 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1340 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:24.250577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:24.251826 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:24.265326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.265809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.266281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:24.267015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.270167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.270632 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:24.492526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:24.502379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-faa76a05-3ac5-419b-b938-91dc432862fe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.257601 Aug 31 04:35:24.503948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 47/86] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:24 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:24.554473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:24.556478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:24.566894 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.570651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.572304 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:24.573462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.575486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.576216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:24.609587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:24.636811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:24.639195 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:24.646660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.647348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.647890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:24.648598 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.649036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.649440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:24.835726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:24.843832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f7f9ea40-9367-4835-865a-82c52a676725 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.214151 Aug 31 04:35:24.844393 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 48/87] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:24 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:24.849390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:24.849984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:24.855947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.856609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.857029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:24.857786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:24.858416 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:24.859257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:25.011623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:25.020568 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:25.022065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:25.024419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b8a2985e-d785-4dc9-951e-1194f6701c84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.177684 Aug 31 04:35:25.025251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 49/88] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:24 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:25.099941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:25.108486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c6f54cdd-a193-4dc7-b4fe-de13ce1c3f7f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.562114 Aug 31 04:35:25.109458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 40/89] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:24 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:25.525768 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:25.526410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:25.545466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:25.546059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:25.548939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:25.551872 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:25.552762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:25.554587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:25.724200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:25.741237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-21fe1408-8b93-4e6a-a465-07a814e6ed76 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.221045 Aug 31 04:35:25.742148 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 50/90] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:25 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:25.864851 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:25.865524 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:25.871878 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:25.873069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:25.874560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:25.875997 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:25.876642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:25.877267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:26.049065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:26.050117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:26.059979 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:26.060990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:26.061627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:26.062486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:26.063312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:26.063820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:26.325307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:26.336667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:26.338771 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:26.340676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f74cdb0e-dcd5-4c9c-b2b2-adbdbe94d93a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.296591 Aug 31 04:35:26.341447 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 51/91] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:26 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:26.342440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:26.350855 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:26.352839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:26.354480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8f6bc25e-43c0-499c-94d7-fd22ad4481f0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.492710 Aug 31 04:35:26.365606 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 41/92] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:25 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:26.404564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:26.405460 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:26.406447 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:26.410256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:26.412432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:26.413239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:26.488890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-ada23c2a-66bb-4735-bc43-ef9d185f3588 req-6bc8efe4-b7e3-49ef-9dbd-8ffb4acf7101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d80f26-ed89-466a-8716-08e48aa7dfb8", "tag": "53ccda52-6f23-4095-832d-ffc497d77603"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:26.524514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ada23c2a-66bb-4735-bc43-ef9d185f3588 req-6bc8efe4-b7e3-49ef-9dbd-8ffb4acf7101 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:26.529637 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ada23c2a-66bb-4735-bc43-ef9d185f3588 req-6bc8efe4-b7e3-49ef-9dbd-8ffb4acf7101 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:26.530494 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ada23c2a-66bb-4735-bc43-ef9d185f3588 req-6bc8efe4-b7e3-49ef-9dbd-8ffb4acf7101 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:26.558756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-ada23c2a-66bb-4735-bc43-ef9d185f3588 req-6bc8efe4-b7e3-49ef-9dbd-8ffb4acf7101 service nova] Creating event network-changed:53ccda52-6f23-4095-832d-ffc497d77603 for instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 on hv-cinder-85530 Aug 31 04:35:26.567182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-ada23c2a-66bb-4735-bc43-ef9d185f3588 req-6bc8efe4-b7e3-49ef-9dbd-8ffb4acf7101 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082455 Aug 31 04:35:26.568465 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 42/93] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:26.659281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:26.669893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-261533c3-f9cc-46bf-bb1c-3a58d67ab85e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.326126 Aug 31 04:35:26.670487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 52/94] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:26 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:26.763305 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:26.764093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:26.772589 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:26.773201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:26.773638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:26.776052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:26.776494 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:26.779461 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:27.023018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:27.032333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d02c9e85-a7fe-4aa9-b442-6de6142c98b7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.273242 Aug 31 04:35:27.045937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 43/95] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:26 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:27.367046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:27.368056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:27.379300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:27.379899 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:27.386784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:27.387271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:27.387693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:27.388391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:27.388831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:27.389243 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:27.393083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:27.393564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:27.393983 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:27.394671 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:27.395134 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:27.395546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:27.660908 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:27.674675 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:27.676439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:27.677806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-43a54bc1-65dd-48d2-b49b-66da447e9f84 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.315282 Aug 31 04:35:27.678494 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 53/96] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:27 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:27.701157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:27.701769 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:27.714928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:27.715421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:27.715812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:27.720187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:27.721027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:27.722941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:27.814579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:27.833200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bcca904d-f07d-4f53-b829-623615a19c6e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.456475 Aug 31 04:35:27.835726 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 44/97] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:27 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:27.991984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:28.010988 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0d786635-53d6-4585-9b34-52e345ef1fab tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.320488 Aug 31 04:35:28.011583 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 54/98] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:27 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:28.055439 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:28.056309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:28.076055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:28.079953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:28.082502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:28.085335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:28.087187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:28.090502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:28.483090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:28.500807 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e9db29f-0db7-412e-b2c5-e68db7ea7118 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.450506 Aug 31 04:35:28.503849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 45/99] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:28 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:28.627312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-2ddfba68-7984-480b-9129-1e404eeca044 req-14efedef-02fd-4dd0-8660-872b413a8af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ba9256-6be0-49de-8c61-4454227a18c8", "tag": "f3809b0b-8437-4e98-88a3-a530ac0d92f8"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:28.644299 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2ddfba68-7984-480b-9129-1e404eeca044 req-14efedef-02fd-4dd0-8660-872b413a8af0 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:28.644997 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2ddfba68-7984-480b-9129-1e404eeca044 req-14efedef-02fd-4dd0-8660-872b413a8af0 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:28.645725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2ddfba68-7984-480b-9129-1e404eeca044 req-14efedef-02fd-4dd0-8660-872b413a8af0 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:28.694535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-2ddfba68-7984-480b-9129-1e404eeca044 req-14efedef-02fd-4dd0-8660-872b413a8af0 service nova] Creating event network-changed:f3809b0b-8437-4e98-88a3-a530ac0d92f8 for instance 16ba9256-6be0-49de-8c61-4454227a18c8 on hv-cinder-85530 Aug 31 04:35:28.702988 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:28.703601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:28.719107 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-2ddfba68-7984-480b-9129-1e404eeca044 req-14efedef-02fd-4dd0-8660-872b413a8af0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099335 Aug 31 04:35:28.720570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 55/100] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:28.729846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:28.730402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:28.730874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:28.731603 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:28.732052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:28.732468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:28.865451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:28.867216 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:28.876503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:28.877202 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:28.879274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:28.882930 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:28.883682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:28.884158 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:29.088852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:29.103042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bc7be5a9-2aef-4bc0-a133-8c9a0bc4b712 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.243996 Aug 31 04:35:29.105381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 56/101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:28 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:29.113483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:29.114707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:29.123464 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:29.124194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:29.125165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:29.126298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:29.127123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:29.127963 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:29.200350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:29.213454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:29.215577 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:29.217134 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b2eb260-2534-4982-998a-f588a172fdcc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.518516 Aug 31 04:35:29.223323 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 46/102] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:28 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:29.315740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:29.325113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-62fb7b4f-1e56-485a-8505-38b604abe350 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.218000 Aug 31 04:35:29.325694 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 57/103] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:29 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:29.526402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:29.527193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:29.535730 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:29.536552 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:29.537293 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:29.538402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:29.539153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:29.539884 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:29.696320 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:29.717210 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f2e221e4-1a78-4adb-a5f8-f9ea973f7a01 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.194809 Aug 31 04:35:29.718262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 47/104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:29 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:30.126113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:30.126766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:30.133652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.134135 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.134764 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.135322 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.135717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.136134 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.140451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:30.241098 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:30.242536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:30.248841 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.249628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.250195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.251110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.251724 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.252278 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.279122 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:30.287254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-99bc09af-185e-4512-8274-7b326c893493 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.165399 Aug 31 04:35:30.296331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 58/105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:30 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:30.348267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:30.349234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:30.356327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.357118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.357767 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.358656 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.359313 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.359946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.468612 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:30.477913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:30.479362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:30.480619 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c7c5ec86-eca3-4e18-97ed-595db5127564 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.243800 Aug 31 04:35:30.481165 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 48/106] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:30 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:30.507190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:30.515176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b9429489-d54f-448b-b24f-4b5dda269d82 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.171838 Aug 31 04:35:30.515744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 59/107] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:30 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:30.747845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:30.748467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:30.754737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.755255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.755683 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.756357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:30.756798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:30.757516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:30.913465 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:30.922371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-43e098a5-169e-4184-b618-d7216e8113a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.180379 Aug 31 04:35:30.922976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 49/108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:30 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:31.309519 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:31.310160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:31.316202 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.316639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.317057 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:31.317727 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.318268 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.318685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:31.459482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:31.467228 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ece98390-5f54-41da-a054-2f55db6490cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.161738 Aug 31 04:35:31.467793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 60/109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:31 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:31.503353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:31.504150 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:31.510397 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.510914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.511339 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:31.512053 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.512499 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.512914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:31.536017 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:31.536616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:31.542974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.543455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.543878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:31.544563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.545252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.545816 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:31.664371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:31.673930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:31.675443 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:31.676631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cc28bba5-4f14-4c3e-9a6c-22fb0e27009d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.177406 Aug 31 04:35:31.677364 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 50/110] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:31 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:31.708110 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:31.717887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5fdd0b6a-b8b2-414c-a766-b1b1583fcf98 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.185657 Aug 31 04:35:31.718455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 61/111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:31 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:31.943685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:31.944232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:31.953992 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.955022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.955662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:31.956363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:31.956817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:31.957237 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:32.273638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:32.282431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-97ebd755-3eac-4aa3-a2c7-d19e5d16c470 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.342766 Aug 31 04:35:32.283061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 51/112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:31 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:32.490475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:32.491258 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:32.500091 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:32.500758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:32.501351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:32.502298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:32.503006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:32.503592 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:32.637019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:32.648983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7453e666-0de2-4d4e-8fc5-b39e0bbe9555 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.163893 Aug 31 04:35:32.649733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 62/113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:32 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:32.701527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:32.702224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:32.709975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:32.710660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:32.711634 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:32.712321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:32.712774 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:32.713191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:32.739013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:32.739616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:32.746579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:32.747041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:32.747463 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:32.748555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:32.749004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:32.749415 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:32.845520 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:32.883071 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:32.891952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:32.892293 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:32.896474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fdc56b5a-0e85-4c0c-859a-6d3e3598a022 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.197424 Aug 31 04:35:32.899137 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 52/114] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:32 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:32.906581 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-364bf036-e4dd-47de-a503-224ddb8e54a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.171342 Aug 31 04:35:32.907347 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 63/115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:32 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:33.304955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:33.306147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:33.314128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.314616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.315074 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.315912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.316344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.317123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.327840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-8369317f-680f-43b4-9e06-1a117c7314af req-ef7b1366-55b7-4c46-ad38-ef9d0da12f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43", "name": "network-vif-plugged", "status": "completed", "tag": "c124b064-1e1f-4174-96ce-6515e6731abc"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:33.348193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8369317f-680f-43b4-9e06-1a117c7314af req-ef7b1366-55b7-4c46-ad38-ef9d0da12f1a service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.348908 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8369317f-680f-43b4-9e06-1a117c7314af req-ef7b1366-55b7-4c46-ad38-ef9d0da12f1a service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.349676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8369317f-680f-43b4-9e06-1a117c7314af req-ef7b1366-55b7-4c46-ad38-ef9d0da12f1a service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.364807 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-8369317f-680f-43b4-9e06-1a117c7314af req-ef7b1366-55b7-4c46-ad38-ef9d0da12f1a service nova] Creating event network-vif-plugged:c124b064-1e1f-4174-96ce-6515e6731abc for instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 on hv-cinder-85530 Aug 31 04:35:33.370501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-8369317f-680f-43b4-9e06-1a117c7314af req-ef7b1366-55b7-4c46-ad38-ef9d0da12f1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126021 Aug 31 04:35:33.372645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 53/116] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:33.491924 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:33.501270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b5ea7860-9dda-4546-a31c-4717c5001e82 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.201397 Aug 31 04:35:33.503174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 64/117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:33 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:33.670523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:33.671094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:33.678348 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.678919 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.679300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.680009 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.681105 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.681546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.870909 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:33.879808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-84bb7824-c106-47c9-9e4b-e105d302d8a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.213546 Aug 31 04:35:33.892839 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 54/118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:33 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:33.921256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:33.923757 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:33.928520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.929029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.929486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.930227 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.930589 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.931024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.937514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:33.938116 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:33.944035 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.944507 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.945261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:33.945666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:33.946382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:33.946778 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:34.066156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:34.075263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:34.076681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:34.079251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6293dc3c-d016-447d-9322-ee83d2eb6b9b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.161608 Aug 31 04:35:34.093597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 65/119] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:33 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:34.104267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:34.114678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5d01003b-7ec1-4d2b-b749-a9698370f208 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.180935 Aug 31 04:35:34.118781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 55/120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:33 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:34.524276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:34.525055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:34.532114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:34.532661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:34.533014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:34.533925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:34.534387 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:34.534913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:34.729541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:34.737252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7ecb74f3-60b8-4edd-9cf5-fe45149c274d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.216941 Aug 31 04:35:34.737826 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 66/121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:34 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:34.900357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:34.900963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:34.906999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:34.907664 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:34.908223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:34.909084 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:34.909681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:34.910276 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.090363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:35.101662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:35.102597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:35.113756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0264ea40-dc73-4c56-a4c0-707702098c94 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.214950 Aug 31 04:35:35.114913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:35.115386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:35.115805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.116525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:35.116959 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 56/122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:34 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:35.117605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:35.118147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.136104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:35.136716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:35.143771 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:35.144939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:35.145627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.146887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:35.147628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:35.148338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.297734 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:35.306593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:35.308059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:35.309129 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fe3d73f8-1474-41d4-98bb-9e38addd03ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.212217 Aug 31 04:35:35.309680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 67/123] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:35 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:35.331234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:35.339797 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6b40d922-fce3-4d87-ae94-f329dcf0718e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1322 microversion: 2.1 time: 0.208069 Aug 31 04:35:35.340367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 57/124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:35 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:35.390109 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-0fc38a43-6df7-405a-8335-f20f5835d754 req-acbf1634-2f7d-4d9e-a338-f6d99a963d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4342bb06-528a-4fff-8494-cfbce3babb99", "name": "network-vif-plugged", "status": "completed", "tag": "5e5c2be7-aa12-4c15-87d9-6d00c7cc9777"}, {"server_uuid": "aaed2599-c3cc-4ac7-91be-29c314bf23cb", "name": "network-vif-plugged", "status": "completed", "tag": "d3c77a9f-10ad-42fc-ba35-41e7e28b3832"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:35.401368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0fc38a43-6df7-405a-8335-f20f5835d754 req-acbf1634-2f7d-4d9e-a338-f6d99a963d3b service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:35.401860 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0fc38a43-6df7-405a-8335-f20f5835d754 req-acbf1634-2f7d-4d9e-a338-f6d99a963d3b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:35.402253 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0fc38a43-6df7-405a-8335-f20f5835d754 req-acbf1634-2f7d-4d9e-a338-f6d99a963d3b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.415018 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-0fc38a43-6df7-405a-8335-f20f5835d754 req-acbf1634-2f7d-4d9e-a338-f6d99a963d3b service nova] Creating event network-vif-plugged:5e5c2be7-aa12-4c15-87d9-6d00c7cc9777 for instance 4342bb06-528a-4fff-8494-cfbce3babb99 on hv-cinder-85530 Aug 31 04:35:35.415533 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-0fc38a43-6df7-405a-8335-f20f5835d754 req-acbf1634-2f7d-4d9e-a338-f6d99a963d3b service nova] Creating event network-vif-plugged:d3c77a9f-10ad-42fc-ba35-41e7e28b3832 for instance aaed2599-c3cc-4ac7-91be-29c314bf23cb on hv-cinder-85530 Aug 31 04:35:35.422310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-0fc38a43-6df7-405a-8335-f20f5835d754 req-acbf1634-2f7d-4d9e-a338-f6d99a963d3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035861 Aug 31 04:35:35.423089 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 68/125] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:35.761286 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:35.762264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:35.783629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:35.789176 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:35.789919 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.790918 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:35.793444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:35.794176 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:35.802958 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:36.053250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:36.082917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e025201b-0d7e-4b76-9d3b-8e1b0ebeea0d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.325300 Aug 31 04:35:36.084158 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 58/126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:35 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:36.136852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:36.137545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:36.144840 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.145321 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.145934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.146964 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.147402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.147955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.331414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:36.333145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:36.349719 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:36.357973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.359532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.360897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.361923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.364194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a17f8389-76d6-462a-b9ef-a135ed20165c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.231978 Aug 31 04:35:36.366396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 69/127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:36 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:36.368906 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.369339 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.373197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:36.374169 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:36.384606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.385331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.386020 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.386982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.387642 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.388544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.633918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:36.643774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6dd00d8b-0c77-449e-9065-2771a2ac9ebc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1517 microversion: 2.1 time: 0.275929 Aug 31 04:35:36.658174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 70/128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:36 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1517 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:36.668042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:36.670784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:36.678086 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.678419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.679066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.679987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:36.680661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:36.681346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:36.754181 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lazy-loading 'flavor' on Instance uuid bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:35:36.870142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:36.890986 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:36.892057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:36.893261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-553adb22-eb3b-43e9-8ba9-7a02d1c314c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.565676 Aug 31 04:35:36.893817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 59/129] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:36 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:36.967395 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8b7e4f03-a3f6-439b-884a-6a2cb5c438bf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43/action" status: 200 len: 32 microversion: 2.1 time: 0.302048 Aug 31 04:35:36.983302 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 71/130] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:35:36 2022] POST /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43/action => generated 32 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:35:36.986752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:36.986936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:37.004922 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.005939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.006403 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.007130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.007809 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.008949 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.114666 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:37.115402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:37.124970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.125465 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.126116 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.127490 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.128275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.129781 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.247597 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:37.256312 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-96b849c3-86c5-4053-8dff-213500c7adc0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.274540 Aug 31 04:35:37.262888 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 60/131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:36 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:37.348467 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:37.359970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9aee062c-ecf5-4f00-85db-1d1ce09ad328 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.250207 Aug 31 04:35:37.360512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 72/132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:37 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:37.396976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:37.397940 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:37.407102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.407761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.408432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.409792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.410622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.411435 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.444725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-dac15034-6933-4741-ad8b-ab2700355d59 req-7e88dd13-d8b0-4e0b-9f0d-e6605bf0c00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ba9256-6be0-49de-8c61-4454227a18c8", "name": "network-vif-plugged", "status": "completed", "tag": "f3809b0b-8437-4e98-88a3-a530ac0d92f8"}, {"server_uuid": "37d80f26-ed89-466a-8716-08e48aa7dfb8", "name": "network-vif-plugged", "status": "completed", "tag": "53ccda52-6f23-4095-832d-ffc497d77603"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:37.458880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-dac15034-6933-4741-ad8b-ab2700355d59 req-7e88dd13-d8b0-4e0b-9f0d-e6605bf0c00d service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.459589 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-dac15034-6933-4741-ad8b-ab2700355d59 req-7e88dd13-d8b0-4e0b-9f0d-e6605bf0c00d service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.460488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-dac15034-6933-4741-ad8b-ab2700355d59 req-7e88dd13-d8b0-4e0b-9f0d-e6605bf0c00d service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.481000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-dac15034-6933-4741-ad8b-ab2700355d59 req-7e88dd13-d8b0-4e0b-9f0d-e6605bf0c00d service nova] Creating event network-vif-plugged:f3809b0b-8437-4e98-88a3-a530ac0d92f8 for instance 16ba9256-6be0-49de-8c61-4454227a18c8 on hv-cinder-85530 Aug 31 04:35:37.482385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-dac15034-6933-4741-ad8b-ab2700355d59 req-7e88dd13-d8b0-4e0b-9f0d-e6605bf0c00d service nova] Creating event network-vif-plugged:53ccda52-6f23-4095-832d-ffc497d77603 for instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 on hv-cinder-85530 Aug 31 04:35:37.491204 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-dac15034-6933-4741-ad8b-ab2700355d59 req-7e88dd13-d8b0-4e0b-9f0d-e6605bf0c00d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054144 Aug 31 04:35:37.493082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 73/133] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:35:37.568110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:37.576324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a7d81cc9-0f79-490d-9d10-f111a8bff72c tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.186251 Aug 31 04:35:37.590566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 61/134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:37 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:37.927692 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:37.928590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:37.938583 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.940667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.941675 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.942585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:37.944131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:37.944902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:37.966757 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:38.168071 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:38.176932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:38.178513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:38.179807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6ee86f61-b781-4188-9929-48ff41a40ea1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.260777 Aug 31 04:35:38.195353 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 74/135] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:37 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:38.281168 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:38.282440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:38.290059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:38.291258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:38.292097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:38.292998 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:38.293634 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:38.294264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:38.381424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:38.382031 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:38.391839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:38.392324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:38.392818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:38.402204 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:38.402984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:38.403690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:38.686253 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:38.698476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5af427f5-54da-4212-a929-e2ea529c35d5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.320759 Aug 31 04:35:38.699308 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 75/136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:38 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:38.708845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:38.712934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:38.718298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:38.721564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:38.730087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:38.731624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:38.733285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:38.735145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ef865ff6-9b06-4b06-8a28-67739d7fbbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.455062 Aug 31 04:35:38.735717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:38.737106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 62/137] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:38 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:38.737425 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:38.740217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:39.185226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:39.201824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-74c0fc48-08e6-4401-96b9-0f13d32649cd tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1315 microversion: 2.1 time: 0.498734 Aug 31 04:35:39.202637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 76/138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:38 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:39.206001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:39.206619 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:39.215189 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:39.215672 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:39.216097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:39.216794 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:39.217256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:39.217641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:39.389324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:39.413561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:39.417353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:39.418973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-03b54a64-fa82-4450-97d5-613eecd2eda3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.217631 Aug 31 04:35:39.419976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 63/139] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:39 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:39.719598 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:39.720811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:39.731546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:39.743139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:39.743783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:39.755145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:39.755613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:39.756036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:39.761143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:39.767142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:39.777872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:39.778495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:39.778889 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:39.780195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:39.781032 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:39.781588 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:39.975182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:39.999713 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4ce4f952-1a72-4eb5-9300-f29ca5573ce0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.278353 Aug 31 04:35:40.000391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 77/140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:39 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:40.225244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:40.225855 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:40.239308 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:40.240356 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:40.241108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:40.242060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:40.243097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:40.244012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:40.269870 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:40.282518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b5e50859-7f46-4302-b7b1-7864638ca665 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.523868 Aug 31 04:35:40.283471 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 64/141] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:39 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:40.443739 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:40.445052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:40.457934 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:40.459362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:40.465160 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:40.466679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:40.467910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:40.469749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:40.470563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:40.476338 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-785be3ce-4efd-4819-a0c6-c1567df7b3af tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1502 microversion: 2.1 time: 0.257340 Aug 31 04:35:40.490744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 78/142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:40 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:40.849168 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:40.870789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:40.872330 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:40.873481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fa178e6c-9ed3-4601-94e1-05e127bcad67 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1407 microversion: 2.20 time: 0.435571 Aug 31 04:35:40.876181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 65/143] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:40 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:35:41.020877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:41.022410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:41.032160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:41.032724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:41.033290 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:41.034100 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:41.035042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:41.036213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:41.279842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:41.287605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ce3fdd6a-5483-4232-b854-d152f1f12fe3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.270512 Aug 31 04:35:41.307699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:41.308538 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:41.316154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:41.316627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:41.317054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:41.317737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:41.318177 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:41.318585 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:41.322735 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 79/144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:41 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:41.523851 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:41.533124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2711af37-88c6-4d82-b778-3736b462d201 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.231021 Aug 31 04:35:41.533928 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 66/145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:41 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:41.898169 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:41.899862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:41.913038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:41.916165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:41.917207 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:41.920475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:41.920951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:41.921388 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.037318 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "216a4a59-c6a7-4732-921d-80f9c2ed9c34"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:42.040090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:42.050329 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.051315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.051982 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.054082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.054825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.058402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.170239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:42.181257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:42.184117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:42.185310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-45d9e24a-52d2-46ab-8f67-9e60d5ee9258 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1599 microversion: 2.20 time: 0.292742 Aug 31 04:35:42.188314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 80/146] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:35:41 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1599 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:35:42.210667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:42.211254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:42.219267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.219938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.220900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.221747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.222436 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.222854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.330778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e80c9894-8b0a-4703-8eb1-355a33218c5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123951 Aug 31 04:35:42.331382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 81/147] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 31 04:35:42 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 04:35:42.336243 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:42.336849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:42.342961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.343442 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.343867 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.344555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.345000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.346914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.713551 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:42.726088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a0494ebb-8425-487b-a1c0-da222044607f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1362 microversion: 2.1 time: 0.393517 Aug 31 04:35:42.727530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 82/148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:42 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:42.734156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:42.735032 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:42.745912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.747303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.747997 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.749294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:42.749957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:42.750679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:42.986396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:43.000088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d34f2119-e425-431d-b581-c3869c36ba87 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.270641 Aug 31 04:35:43.000677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 83/149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:42 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:43.612544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5cd5f9d0-86ee-425c-b21a-3fcf9baaf4a6 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "POST /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.578507 Aug 31 04:35:43.613772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 67/150] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:35:42 2022] POST /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99/os-volume_attachments => generated 194 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:35:43.766383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:43.766895 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:43.780009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:43.780931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:43.782002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:43.783239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:43.784127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:43.784726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:44.023685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:44.025696 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:44.032342 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=93 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:44.048014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:44.050914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:44.052245 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:44.056987 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:44.057667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:44.059110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:44.081139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:44.089570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c79cc605-fb8c-438f-b878-883f43ec0d23 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1548 microversion: 2.1 time: 0.328269 Aug 31 04:35:44.098784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 84/151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:43 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1548 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:44.116784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:44.117260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:44.127435 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:44.127921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:44.128345 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:44.130557 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:44.131039 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:44.134647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:44.289468 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e07d8160-23c7-4ad9-a7b0-4985366280a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176308 Aug 31 04:35:44.295022 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 85/152] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:35:44 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:44.427265 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:44.440285 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-72804cf0-9906-465e-b42e-3cf43aedb23e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.420163 Aug 31 04:35:44.441100 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 68/153] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:44 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:44.594304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-a63978bf-8934-4b10-ac3d-ed95ffe24cd1 req-1814908f-6e18-4844-8e52-e50d5c30ba69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ba9256-6be0-49de-8c61-4454227a18c8", "tag": "f3809b0b-8437-4e98-88a3-a530ac0d92f8"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:44.608794 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-a63978bf-8934-4b10-ac3d-ed95ffe24cd1 req-1814908f-6e18-4844-8e52-e50d5c30ba69 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:44.609512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-a63978bf-8934-4b10-ac3d-ed95ffe24cd1 req-1814908f-6e18-4844-8e52-e50d5c30ba69 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:44.610075 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-a63978bf-8934-4b10-ac3d-ed95ffe24cd1 req-1814908f-6e18-4844-8e52-e50d5c30ba69 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:44.623382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-a63978bf-8934-4b10-ac3d-ed95ffe24cd1 req-1814908f-6e18-4844-8e52-e50d5c30ba69 service nova] Creating event network-changed:f3809b0b-8437-4e98-88a3-a530ac0d92f8 for instance 16ba9256-6be0-49de-8c61-4454227a18c8 on hv-cinder-85530 Aug 31 04:35:44.630175 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-a63978bf-8934-4b10-ac3d-ed95ffe24cd1 req-1814908f-6e18-4844-8e52-e50d5c30ba69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040290 Aug 31 04:35:44.635408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 86/154] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:45.461654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:45.463236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:45.476428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:45.477343 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:45.479938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:45.482550 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:45.483278 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:45.485111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:45.893273 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:45.911554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c73cd4b9-e7a8-4928-bbfb-7abcf2c665a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.453705 Aug 31 04:35:45.925389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 69/155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:45 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:46.444129 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-d94fea00-e1e2-47f6-baf1-15e4486c5f5e req-7afe969c-32c6-4c60-848d-d219d9948fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d80f26-ed89-466a-8716-08e48aa7dfb8", "tag": "53ccda52-6f23-4095-832d-ffc497d77603"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:46.456559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-d94fea00-e1e2-47f6-baf1-15e4486c5f5e req-7afe969c-32c6-4c60-848d-d219d9948fa5 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:46.457195 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-d94fea00-e1e2-47f6-baf1-15e4486c5f5e req-7afe969c-32c6-4c60-848d-d219d9948fa5 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:46.457753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-d94fea00-e1e2-47f6-baf1-15e4486c5f5e req-7afe969c-32c6-4c60-848d-d219d9948fa5 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:46.470783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-d94fea00-e1e2-47f6-baf1-15e4486c5f5e req-7afe969c-32c6-4c60-848d-d219d9948fa5 service nova] Creating event network-changed:53ccda52-6f23-4095-832d-ffc497d77603 for instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 on hv-cinder-85530 Aug 31 04:35:46.480025 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-d94fea00-e1e2-47f6-baf1-15e4486c5f5e req-7afe969c-32c6-4c60-848d-d219d9948fa5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039920 Aug 31 04:35:46.484615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 87/156] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:46.933469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:46.934076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:46.945642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:46.949417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:46.951068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:46.952267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:46.953021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:46.953787 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:47.287604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:47.303261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-afef6d33-6f88-4085-acb9-786510352cd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.374768 Aug 31 04:35:47.303844 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 70/157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:46 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:48.326351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:48.327046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:48.333661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:48.334291 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:48.334779 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:48.335481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:48.335922 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:48.336330 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:48.475351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:48.486972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5e65c870-ad23-41af-9f26-23ed3d4ff9fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.164412 Aug 31 04:35:48.487786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 88/158] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:48 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:49.509586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:49.510233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:49.516789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:49.517261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:49.517679 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:49.518356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:49.518821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:49.519232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:49.684489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:49.692650 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e7357d65-6190-45a1-8ec4-944b6534cdd8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.186864 Aug 31 04:35:49.693216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 71/159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:49 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:50.715993 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:50.716975 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:50.723432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:50.724121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:50.724547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:50.725339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:50.726041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:50.726790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:50.860386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:50.868011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4a209838-856d-4000-9235-2ce4812babbe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.158382 Aug 31 04:35:50.868597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 89/160] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:50 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:51.889850 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:51.890459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:51.897286 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:51.897763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:51.898187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:51.898921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:51.899347 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:51.899876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:52.077070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:52.089401 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-79bae9e7-f9f1-4cc1-813a-47b3405c79ee tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.203403 Aug 31 04:35:52.090302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 72/161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:51 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:52.910620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:52.911237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:52.917884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:52.918355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:52.918808 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:52.919476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:52.920077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:52.920491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:52.947012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:35:53.034000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d75c0736-f71d-467f-90f2-fbbedd2a9ac8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 204 len: 0 microversion: 2.1 time: 0.127135 Aug 31 04:35:53.034997 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 90/162] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:35:52 2022] DELETE /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:35:53.045164 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:53.046054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:53.058381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:53.058892 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:53.059309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:53.060100 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:53.060554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:53.060945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:53.082704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:53.113680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:53.114367 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:53.120669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:53.121144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:53.121567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:53.122254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:53.122697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:53.123153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:53.127311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:53.200467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:53.209875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-78583e18-356e-431b-a60c-5325915d8cb8 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1554 microversion: 2.1 time: 0.170124 Aug 31 04:35:53.210463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 73/163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:53 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:53.254954 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:53.262602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fb11b2a2-5f4f-4028-b1cb-3ff6849c3484 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.153641 Aug 31 04:35:53.263187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 91/164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:53 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:54.231599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:54.232508 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:54.240568 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:54.241137 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:54.241646 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:54.243120 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:54.243811 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:54.244409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:54.286898 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:54.287324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:54.294448 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:54.294936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:54.295532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:54.296367 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:54.296949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:54.297535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:54.388984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:54.397396 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b6df5a4-6e99-451b-b296-e609ce89523b tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1554 microversion: 2.1 time: 0.169974 Aug 31 04:35:54.397968 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 74/165] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:54 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:54.440278 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:54.448811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cf7a3c51-e626-43bd-b45d-a5f29ab7ced1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.166422 Aug 31 04:35:54.449377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 92/166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:54 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:55.429264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:55.429264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:55.429264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:55.429264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:55.429875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:55.429875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:55.429875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:55.429875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:55.483515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:55.484117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:55.490569 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:55.491269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:55.492003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:55.492859 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:55.493639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:55.494706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:55.624523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:55.633635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2b5a44dc-f419-4598-812b-7a0fb164602e tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1554 microversion: 2.1 time: 0.219925 Aug 31 04:35:55.634224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 75/167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:55 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:55.663669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:55.672277 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ec360054-b62c-46d5-9657-ca1fe1f0de20 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.203821 Aug 31 04:35:55.673576 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 93/168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:55 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:56.190790 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-f20ffaec-b5f2-49b3-b2b3-8602beb640b2 req-5767d6e2-50a6-4c68-b461-1c10df2e636c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4342bb06-528a-4fff-8494-cfbce3babb99", "name": "network-vif-deleted", "tag": "5e5c2be7-aa12-4c15-87d9-6d00c7cc9777"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:35:56.200579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-f20ffaec-b5f2-49b3-b2b3-8602beb640b2 req-5767d6e2-50a6-4c68-b461-1c10df2e636c service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:56.201056 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-f20ffaec-b5f2-49b3-b2b3-8602beb640b2 req-5767d6e2-50a6-4c68-b461-1c10df2e636c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:56.201690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-f20ffaec-b5f2-49b3-b2b3-8602beb640b2 req-5767d6e2-50a6-4c68-b461-1c10df2e636c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:56.213378 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-f20ffaec-b5f2-49b3-b2b3-8602beb640b2 req-5767d6e2-50a6-4c68-b461-1c10df2e636c service nova] Creating event network-vif-deleted:5e5c2be7-aa12-4c15-87d9-6d00c7cc9777 for instance 4342bb06-528a-4fff-8494-cfbce3babb99 on hv-cinder-85530 Aug 31 04:35:56.218912 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-f20ffaec-b5f2-49b3-b2b3-8602beb640b2 req-5767d6e2-50a6-4c68-b461-1c10df2e636c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031748 Aug 31 04:35:56.219569 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 76/169] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:35:56.656251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:56.657626 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:56.663745 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:56.664273 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:56.664832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:56.665493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:56.666115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:56.666517 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:56.699514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:56.700214 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:56.706646 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:56.707156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:56.707575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:56.708231 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:56.708676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:56.709086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:56.730952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f863757bba840ea85db119179b9fc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2967ca7d73584b45baa158f5994f64df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:56.739296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-411e3715-314c-4fcb-8729-f5f9f059e88f tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 200 len: 1346 microversion: 2.1 time: 0.088465 Aug 31 04:35:56.739896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 94/170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:56 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:56.853011 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:56.861856 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c9d34bd1-01f9-4e0f-a563-64bba52f24fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.167001 Aug 31 04:35:56.862558 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 77/171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:56 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:35:57.760709 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:57.761558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:57.768802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:57.769294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:57.770397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:57.770662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:57.771312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:57.771731 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:57.791943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] HTTP exception thrown: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Request method failure captured: Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 HTTP/1.1 Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTkzh57dhnMjc0XhlI-QEuZVdudohAfCsv9a0CxVG45ow1NHi4TuefHHI30KhViNX_1N6FNFlhORlQkNs3CmS73_0WW0pN4a2dI98bJCh5xFoBIlfrlF-FNPa0Y9eW55eBQSNLuUgu2OpGU4k8XAfOP-GzeDPVLV7Yi0rssQGGtCpk Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:35:57.798606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2967ca7d73584b45baa158f5994f64df", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}] Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 0f863757bba840ea85db119179b9fc7c Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.799892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '4342bb06-528a-4fff-8494-cfbce3babb99'} Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:35:57.800619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.801723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.803145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Returning 404 to user: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:35:57.803145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4ee056a0-b18c-48cd-9e2d-94792aea33c0 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 404 len: 111 microversion: 2.1 time: 0.043807 Aug 31 04:35:57.804429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 95/172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:57 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:35:57.884825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:57.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:57.905803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:57.905803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:57.905803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:57.905803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:57.906201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:57.906201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:57.918358 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:57.920918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:57.928151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:57.928304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:57.928698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:57.929484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:57.929933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:57.930347 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:57.943547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] HTTP exception thrown: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Request method failure captured: Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99/os-volume_attachments HTTP/1.1 Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTkzh57dhnMjc0XhlI-QEuZVdudohAfCsv9a0CxVG45ow1NHi4TuefHHI30KhViNX_1N6FNFlhORlQkNs3CmS73_0WW0pN4a2dI98bJCh5xFoBIlfrlF-FNPa0Y9eW55eBQSNLuUgu2OpGU4k8XAfOP-GzeDPVLV7Yi0rssQGGtCpk Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:35:57.945774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2967ca7d73584b45baa158f5994f64df", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}] Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 0f863757bba840ea85db119179b9fc7c Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.947219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'server_id': '4342bb06-528a-4fff-8494-cfbce3babb99'} Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:35:57.948211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:57.949722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:35:57.951458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Returning 404 to user: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:35:57.951458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-98d7bac8-296c-4db8-96aa-247349176d64 tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032866 Aug 31 04:35:57.951458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 96/173] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:35:57 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:35:58.079939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:58.088687 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b3fb90f-4673-4046-a0ff-3bb941b86f8f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.208743 Aug 31 04:35:58.089307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 78/174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:57 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:35:59.111082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:59.111829 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:59.118401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:59.119126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:59.119642 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:59.120656 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:59.121391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:59.121957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:59.201928 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:59.203325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:59.215329 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:59.216048 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:59.217048 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:59.217785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:59.218241 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:59.218691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:59.240732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] HTTP exception thrown: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Request method failure captured: Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 HTTP/1.1 Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTkzh57dhnMjc0XhlI-QEuZVdudohAfCsv9a0CxVG45ow1NHi4TuefHHI30KhViNX_1N6FNFlhORlQkNs3CmS73_0WW0pN4a2dI98bJCh5xFoBIlfrlF-FNPa0Y9eW55eBQSNLuUgu2OpGU4k8XAfOP-GzeDPVLV7Yi0rssQGGtCpk Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:35:59.246410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2967ca7d73584b45baa158f5994f64df", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}] Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 0f863757bba840ea85db119179b9fc7c Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.248192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '4342bb06-528a-4fff-8494-cfbce3babb99'} Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:35:59.248956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.250103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.252365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Returning 404 to user: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:35:59.252365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-17710766-7ae6-4901-a5cf-7e17adc8ce7d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 404 len: 111 microversion: 2.1 time: 0.051351 Aug 31 04:35:59.252365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 79/175] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:35:59 2022] DELETE /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:35:59.264254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:35:59.265102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] [instance: 4342bb06-528a-4fff-8494-cfbce3babb99] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:35:59.274641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:59.276042 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:59.276469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:59.278115 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:35:59.278599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:35:59.280685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:35:59.304820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] HTTP exception thrown: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Request method failure captured: Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 HTTP/1.1 Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTkzh57dhnMjc0XhlI-QEuZVdudohAfCsv9a0CxVG45ow1NHi4TuefHHI30KhViNX_1N6FNFlhORlQkNs3CmS73_0WW0pN4a2dI98bJCh5xFoBIlfrlF-FNPa0Y9eW55eBQSNLuUgu2OpGU4k8XAfOP-GzeDPVLV7Yi0rssQGGtCpk Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:35:59.306653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2967ca7d73584b45baa158f5994f64df", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2967ca7d73584b45baa158f5994f64df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2967ca7d73584b45baa158f5994f64df"}]}] Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 2967ca7d73584b45baa158f5994f64df Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602299198 Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 0f863757bba840ea85db119179b9fc7c Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-DeleteServersTestJSON-1602299198-project Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.308153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '4342bb06-528a-4fff-8494-cfbce3babb99'} Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:35:59.308927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. Aug 31 04:35:59.310456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:35:59.311702 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] Returning 404 to user: Instance 4342bb06-528a-4fff-8494-cfbce3babb99 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:35:59.320224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-96cf9dcb-16c0-415d-9db5-7b5517fe303d tempest-DeleteServersTestJSON-1602299198 tempest-DeleteServersTestJSON-1602299198-project] 10.222.0.42 "GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99" status: 404 len: 111 microversion: 2.1 time: 0.066205 Aug 31 04:35:59.321382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 80/176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:59 2022] GET /compute/v2.1/servers/4342bb06-528a-4fff-8494-cfbce3babb99 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:35:59.437912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:35:59.446777 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7f3bf8e9-fbd9-4c17-9019-f5690972f296 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.339597 Aug 31 04:35:59.447961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 97/177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:35:59 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:00.469233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:00.469824 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:00.477251 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:00.478175 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:00.478793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:00.479642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:00.481431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:00.482480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:01.038526 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:01.052151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0d2be48d-3c20-47af-9835-d4b98fed9b97 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.587381 Aug 31 04:36:01.053336 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 81/178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:00 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:02.075454 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:02.076190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:02.089970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:02.090606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:02.092118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:02.092907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:02.093225 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:02.093704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:02.364780 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:02.376706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5a53489e-949c-45e6-acfa-64db05e4efa3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.305968 Aug 31 04:36:02.378970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 98/179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:02 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:03.401330 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:03.402668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:03.414248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:03.414897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:03.415541 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:03.416365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:03.416814 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:03.417234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:03.611447 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:03.623828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cd6d9e2a-5aa2-4e22-b732-d2a19cf52194 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.226235 Aug 31 04:36:03.624578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 82/180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:03 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:04.645725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:04.647136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:04.663405 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:04.664610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:04.665647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:04.668665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:04.669843 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:04.670970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:04.904706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:04.914936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f7c82d03-2684-482a-8042-3b2c747ca93a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.274112 Aug 31 04:36:04.916410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 99/181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:04 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:05.937798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:05.938407 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:05.945093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:05.945566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:05.945984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:05.946668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:05.947155 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:05.947564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:06.119239 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:06.129936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-da0e472b-08a0-402e-8135-cb99255b4324 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.196707 Aug 31 04:36:06.130594 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 83/182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:05 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:07.151060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:07.151664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:07.157939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:07.158409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:07.158858 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:07.159540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:07.159974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:07.160379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:07.299989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:07.307935 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f0581077-7e29-4fa7-bfcd-4255d4df2074 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.160824 Aug 31 04:36:07.308500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 100/183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:07 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:08.330029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:08.330804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:08.337925 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:08.338536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:08.339009 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:08.339807 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:08.340339 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:08.340766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:08.524846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:08.541587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-36a76847-7006-4872-819e-dff94652009d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.215927 Aug 31 04:36:08.542567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 84/184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:08 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:09.569575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:09.570928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:09.572972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:09.579310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:09.579769 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:09.580366 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:09.581062 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:09.581557 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:09.581965 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:09.719791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:09.727666 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d925c65d-076d-49c9-9024-53fdd753c7f3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.162202 Aug 31 04:36:09.728218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 101/185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:09 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:10.750586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:10.751220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:10.758124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:10.758928 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:10.759359 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:10.760057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:10.760487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:10.760901 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:10.919254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:10.927938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-09cfa20e-ea14-41a0-81db-e25c4cda17b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.181591 Aug 31 04:36:10.928642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 85/186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:10 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:11.949544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:11.950181 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:11.957452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:11.957930 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:11.958354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:11.959161 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:11.959662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:11.960073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:12.099995 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:12.109741 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f5f8841a-0a3c-48f8-aeb5-17de9557c354 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.163727 Aug 31 04:36:12.110519 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 102/187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:11 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:13.130748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:13.131352 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:13.137668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:13.138341 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:13.138789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:13.139483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:13.139953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:13.140367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:13.304567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:13.318775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8746d197-a01f-4e60-a0bb-92dfbb60addf tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.191884 Aug 31 04:36:13.319352 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 86/188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:13 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:14.341544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:14.342911 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:14.350472 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:14.351282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:14.351825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:14.352614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:14.353165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:14.353747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:14.571433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:14.579839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c79ce9ef-4b56-46a2-aa27-2b0b9aa7e5a4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.242916 Aug 31 04:36:14.580420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 103/189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:14 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:15.603300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:15.604000 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:15.606912 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=38 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:15.613791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:15.614273 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:15.614761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:15.615452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:15.615894 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:15.616489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:15.764799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:15.772391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6e2dea7b-a0a1-4f89-89e4-dd28a820a6d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.173463 Aug 31 04:36:15.772981 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 87/190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:15 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:16.796433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:16.797008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:16.804799 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:16.805392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:16.805934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:16.806791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:16.807341 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:16.807875 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:16.942745 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:16.952096 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9b42eda9-c213-4a44-840e-a07b5ab99bb4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.160725 Aug 31 04:36:16.952659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 104/191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:16 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:17.976052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:17.977399 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:17.985332 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:17.985815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:17.986243 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:17.986963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:17.987416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:17.987846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:18.127572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:18.135301 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9710678e-b6d5-4351-8f10-6958e9ef2bf4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.164919 Aug 31 04:36:18.135873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 88/192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:17 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:19.157783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:19.158414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:19.165577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:19.166050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:19.166475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:19.167231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:19.168152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:19.168152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:19.323739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:19.334253 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-aab96dce-7b37-4a9c-a3b4-ef34a66fe855 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.180507 Aug 31 04:36:19.342456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 105/193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:19 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:20.355835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:20.356446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:20.363073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:20.363754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:20.364179 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:20.364864 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:20.365297 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:20.365710 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:20.507207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:20.517133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dc713bc5-ea85-4ef9-8a07-e914a764aa09 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.165177 Aug 31 04:36:20.517731 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 89/194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:20 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:21.545776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:21.546759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:21.553014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:21.553485 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:21.553904 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:21.554543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:21.555053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:21.555457 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:21.703934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:21.712071 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2c334e80-cc96-4818-9fcb-18642b4aef13 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.170235 Aug 31 04:36:21.712607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 106/195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:21 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:22.736572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:22.737151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:22.744651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:22.745182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:22.745661 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:22.746426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:22.746966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:22.747430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:22.886644 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:22.895173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eb156d13-8d38-4418-9faa-3c3bd32c95e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.164096 Aug 31 04:36:22.895701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 90/196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:22 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:23.917314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:23.918471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:23.924901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:23.925384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:23.925843 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:23.926801 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:23.927180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:23.927757 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:23.931838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=87 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:24.069379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:24.078842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f61ea2df-faeb-44f3-b9ba-6a3dab27ea56 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1523 microversion: 2.1 time: 0.165764 Aug 31 04:36:24.080345 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 107/197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:23 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:25.101530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:25.102190 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:25.111223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:25.111713 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:25.112247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:25.113003 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:25.113591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:25.114186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:25.118594 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=93 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:25.305060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:25.315733 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8affabf6-7c4a-463d-bdcb-ec4734f0f754 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1503 microversion: 2.1 time: 0.218699 Aug 31 04:36:25.317055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 91/198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:25 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:25.337423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:25.338013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:25.352082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:25.352500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:25.352920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:25.353631 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:25.354204 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:25.354815 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:25.510226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:25.527799 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-035ccd42-9e4f-4284-b441-2e80729d18e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1516 microversion: 2.1 time: 0.194648 Aug 31 04:36:25.528378 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 108/199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:25 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:27.094676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:36:27.096250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:27.105001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:27.105516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:27.106035 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:27.106671 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:27.107224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:27.107677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:27.152882 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lazy-loading 'flavor' on Instance uuid aaed2599-c3cc-4ac7-91be-29c314bf23cb {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:36:27.340534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-15019f86-6f96-44d1-a956-6c525c402c8c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb/action" status: 200 len: 32 microversion: 2.1 time: 0.251453 Aug 31 04:36:27.341167 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 92/200] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:36:27 2022] POST /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 04:36:27.365450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:27.366145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:27.372309 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:27.373056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:27.373852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:27.374877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:27.375377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:27.375870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:27.545457 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:27.556229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-db65dcf0-e419-48f0-a72e-c62fceed6df1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.208244 Aug 31 04:36:27.556941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 109/201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:27 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:28.578241 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:28.579053 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:28.586436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:28.586946 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:28.587395 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:28.588108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:28.588561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:28.588977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:28.725905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:28.733902 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-516f31cd-d046-4a37-b520-ab71b7a212ff tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.159994 Aug 31 04:36:28.734480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 93/202] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:28 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:29.761953 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:29.762558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:29.769475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:29.769954 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:29.770374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:29.771081 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:29.771520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:29.771925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:29.908504 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:29.916703 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-96baf965-43b5-4699-9f13-19b5f7db8693 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.165312 Aug 31 04:36:29.917251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 110/203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:29 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:30.937774 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:30.938442 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:30.945543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:30.945997 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:30.946418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:30.947131 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:30.947564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:30.947973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:31.092554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:31.101293 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1562e255-6fc8-4e6f-8409-3d9abfad07f9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.167681 Aug 31 04:36:31.103374 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 94/204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:30 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:32.121708 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:32.122505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:32.128991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:32.129555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:32.130049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:32.130837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:32.131344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:32.131830 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:32.266788 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:32.275484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-963de7f3-33af-4cf3-9297-13cc37058067 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.157768 Aug 31 04:36:32.276136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 111/205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:32 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:33.299271 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:33.300741 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:33.310972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:33.311818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:33.312810 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:33.313751 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:33.314590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:33.314590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:33.525264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:33.535367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-146e7f2d-318b-40d8-ba2c-16a742365d14 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.240087 Aug 31 04:36:33.535367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 95/206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:33 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:34.555773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:34.556377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:34.563707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:34.564183 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:34.564604 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:34.565343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:34.565920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:34.566333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:34.713846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:34.722641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5bfedd95-ad90-4922-9a8c-63c376ce7e4e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.170352 Aug 31 04:36:34.723558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 112/207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:34 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:35.744100 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:35.744695 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:35.753363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:35.753963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:35.754528 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:35.755526 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:35.756035 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:35.756497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:35.939471 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:35.948725 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1f27062e-8e47-49e0-af09-af600912b71f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.208590 Aug 31 04:36:35.949531 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 96/208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:35 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:36.973660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:36.974270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:36.980378 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:36.980861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:36.981289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:36.981981 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:36.982432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:36.982872 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:37.148907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:37.158559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-606bc205-5503-47cb-853d-844ddd4e1028 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.188945 Aug 31 04:36:37.159344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 113/209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:36 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:38.179807 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:38.180592 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:38.194996 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:38.195560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:38.196933 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:38.197758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:38.200309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:38.201020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:38.441572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:38.451911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-474a0b03-8d88-4eca-88c2-1aab7c3b38a1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.275788 Aug 31 04:36:38.452496 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 97/210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:38 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:36:39.478027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:39.479503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:39.486907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:39.487795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:39.488443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:39.489366 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:39.489938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:39.490493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:39.658983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:39.671295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0449945d-1938-4022-86a4-0e88fbd0d6b3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.198916 Aug 31 04:36:39.675097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 114/211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:39 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:39.738896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2068869454", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:36:39.814261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] validate_networks() for None {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:36:40.162155 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:36:40.162568 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:36:40.163053 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:36:40.163446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:36:40.163970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:36:40.175544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:40.176015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:40.176436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:40.177137 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:40.178255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:40.178973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:40.200482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Getting quotas for project 80dd3f85755d4deea3fc0192c1cbbc4b. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:36:40.212102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Getting quotas for user 294d5d11423c4d2bad05afacdd999995 and project 80dd3f85755d4deea3fc0192c1cbbc4b. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:36:40.224967 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:36:40.227315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:36:40.278918 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b07a31e7-6497-4c1c-8ee3-e9730df4c558 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544400 Aug 31 04:36:40.280173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 98/212] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:36:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:36:40.293023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-835ed545-cca2-4634-9966-466531f8aa95 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:40.293839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-835ed545-cca2-4634-9966-466531f8aa95 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:40.299274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=28 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:40.386623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-835ed545-cca2-4634-9966-466531f8aa95 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:40.399580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-835ed545-cca2-4634-9966-466531f8aa95 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1215 microversion: 2.1 time: 0.112368 Aug 31 04:36:40.400680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 115/213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:40 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:36:40.698843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:40.699383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:40.708630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:40.709256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:40.709688 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:40.710376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:40.710915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:40.711325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:40.873321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:40.884172 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-adcaf8db-734e-481a-b92f-b8205e8000e5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.189558 Aug 31 04:36:40.884493 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 99/214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:40 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:41.421967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:41.422979 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:41.429537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:41.430234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:41.430835 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:41.431525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:41.431961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:41.432364 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:41.495257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:41.503016 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f980c4c3-0c11-4538-92de-7abc4add5f4f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1267 microversion: 2.1 time: 0.085433 Aug 31 04:36:41.503577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 116/215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:41 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:41.910641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:41.912865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:41.921643 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:41.922050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:41.923228 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:41.924007 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:41.924456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:41.925195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:42.061282 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:42.070298 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0e3bed4c-dc27-4586-858e-33c2068789a2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.168581 Aug 31 04:36:42.070912 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 100/216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:41 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:42.281326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:42.281326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:42.285031 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:42.285723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:42.286149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:42.286861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:42.287307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:42.288136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:42.313238 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5d598dfd-aaca-4156-9602-407187c226d0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/ips" status: 200 len: 151 microversion: 2.20 time: 0.038805 Aug 31 04:36:42.314240 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 117/217] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 31 04:36:42 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:36:42.494971 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:42.495454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:42.501793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:42.502273 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:42.502786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:42.503474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:42.503921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:42.504332 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:42.524063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:42.524744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:42.533641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:42.534114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:42.534531 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:42.535257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:42.535671 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:42.536077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:42.539142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b5141294-dc63-4faa-a919-4172c5908ba2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/ips" status: 200 len: 145 microversion: 2.1 time: 0.047801 Aug 31 04:36:42.539770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 101/218] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:36:42 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:36:42.609152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:42.618065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-628e4983-410d-4564-9880-ea1c6f536f60 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1273 microversion: 2.1 time: 0.097761 Aug 31 04:36:42.618644 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 118/219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:42 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:36:43.093189 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:43.093910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:43.100858 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:43.101336 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:43.101745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:43.102422 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:43.102903 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:43.103319 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:43.241817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:43.249651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0bfc7384-8bad-4c92-babb-c301e0ce43a6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.161187 Aug 31 04:36:43.250227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 102/220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:43 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:43.642740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:43.643252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:43.649741 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:43.650223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:43.650759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:43.651446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:43.651881 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:43.652296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:43.712928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:43.720842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-80073f7d-b8b7-4cb5-9634-614893cf9448 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1273 microversion: 2.1 time: 0.084155 Aug 31 04:36:43.721397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 119/221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:43 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:44.274354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:44.275516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:44.286492 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:44.287329 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:44.288004 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:44.289141 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:44.289863 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:44.290548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:44.429430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:44.437652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bd193658-bc60-4aa0-8991-bd878c701940 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.169723 Aug 31 04:36:44.438545 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 103/222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:44 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:44.742164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:44.742798 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:44.750657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:44.751262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:44.752287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:44.753178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:44.753779 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:44.754340 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:44.834209 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:44.842372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f597ee35-57ac-47e6-b5ec-ac9630e07f8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1273 microversion: 2.1 time: 0.104443 Aug 31 04:36:44.843307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 120/223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:44 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:45.461809 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:45.462645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:45.471813 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:45.473392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:45.473817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:45.474885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:45.475478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:45.476194 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:45.803733 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:45.812431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-30d7972e-9423-4450-a3d3-f66bdb9d0308 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.356409 Aug 31 04:36:45.812994 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 104/224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:45 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:45.864057 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:45.864690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:45.871111 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:45.871587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:45.872011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:45.872689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:45.873133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:45.873543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:46.004772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:46.012823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-db7132f7-4b58-43d3-b940-b8495852f6ff tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.153253 Aug 31 04:36:46.013401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 121/225] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:45 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:46.836723 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:46.837632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:46.841665 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:46.849017 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:46.849494 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:46.849916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:46.850600 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:46.851065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:46.851473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:46.993052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:47.001820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-590d8041-01cd-472a-90bc-db99a71fd8f0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.171086 Aug 31 04:36:47.002379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 105/226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:46 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:47.034287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:47.034956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:47.041120 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:47.041579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:47.041992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:47.042657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:47.043247 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:47.043655 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:47.179508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:47.190934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e6fdd560-6907-4d2e-bb6f-537e36d7b591 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.160309 Aug 31 04:36:47.191579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 122/227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:47 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:36:48.023128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:48.023723 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:48.030443 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:48.030962 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:48.031385 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:48.032074 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:48.032536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:48.032970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:48.215873 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:48.216590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:48.224029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:48.224512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:48.224944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:48.225660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:48.226089 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:48.226502 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:48.375765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:48.384629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-086e6f15-a187-4b23-9ffb-477fe7a62904 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.172677 Aug 31 04:36:48.385288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 123/228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:48 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:36:48.546083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:48.549437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:48.561186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-531a3402-9c3f-465b-9bb7-0c0f69118f5b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.541826 Aug 31 04:36:48.561748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 106/229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:48 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:49.068009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-2f3e14be-433d-4ef4-b128-d2af9cc11872 req-7e4aef5d-34a8-4d10-87c2-d601788a6f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48e5c2f-aa5d-4351-9309-c69f06b9131e", "tag": "d07fc2fb-c684-423c-9262-8b9678531baf"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:36:49.080090 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2f3e14be-433d-4ef4-b128-d2af9cc11872 req-7e4aef5d-34a8-4d10-87c2-d601788a6f9f service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:49.080560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2f3e14be-433d-4ef4-b128-d2af9cc11872 req-7e4aef5d-34a8-4d10-87c2-d601788a6f9f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:49.081130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2f3e14be-433d-4ef4-b128-d2af9cc11872 req-7e4aef5d-34a8-4d10-87c2-d601788a6f9f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:49.094051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-2f3e14be-433d-4ef4-b128-d2af9cc11872 req-7e4aef5d-34a8-4d10-87c2-d601788a6f9f service nova] Creating event network-changed:d07fc2fb-c684-423c-9262-8b9678531baf for instance f48e5c2f-aa5d-4351-9309-c69f06b9131e on hv-cinder-85530 Aug 31 04:36:49.102511 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-2f3e14be-433d-4ef4-b128-d2af9cc11872 req-7e4aef5d-34a8-4d10-87c2-d601788a6f9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038743 Aug 31 04:36:49.103186 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 124/230] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:36:49.408549 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:49.409060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:49.418663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:49.419385 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:49.419976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:49.420858 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:49.421514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:49.422111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:49.565040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:49.576306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-275ce63b-ece3-44f0-b99a-8e7a9566501b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.174129 Aug 31 04:36:49.576887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 107/231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:49 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:49.583613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:49.584310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:49.592409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:49.592918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:49.593344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:49.594088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:49.594531 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:49.595121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:49.737064 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:49.739420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:49.746260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8e262fb2-9733-42f4-83a6-42b28081c7bc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.167561 Aug 31 04:36:49.746848 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 125/232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:49 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:50.600270 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:50.601046 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:50.603275 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:50.604067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:50.612667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:50.613237 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:50.613779 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:50.614627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:50.615208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:50.615723 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:50.758483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:50.766612 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-22860d55-8a7d-4144-8cd7-c456be39f076 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.172159 Aug 31 04:36:50.767190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:50.767655 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 108/233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:50 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:50.767796 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:50.769919 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:50.775677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:50.776183 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:50.776602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:50.777284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:50.777721 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:50.778127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:50.924329 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:50.932954 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-117b2e33-7788-46fe-8f7a-d5d6260ad6d5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.169855 Aug 31 04:36:50.933456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 126/234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:50 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:51.789977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:51.790601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:51.797763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:51.798246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:51.798647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:51.799399 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:51.799920 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:51.800406 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:51.941333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:51.952181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8470adcb-8839-4a35-b4dc-d686c51dd383 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.166284 Aug 31 04:36:51.963943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 109/235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:51 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:51.967073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:51.968199 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:51.975258 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:51.975896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:51.976318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:51.977035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:51.977475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:51.977886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:52.174204 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:52.185909 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0d660015-8dcc-456c-9e9f-692c1e8b3bb0 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.224298 Aug 31 04:36:52.187337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 127/236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:51 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:36:52.557492 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a3edfa6-db83-4766-98c1-b4426395d530"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:36:52.560436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:52.566502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:52.567376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:52.567798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:52.568484 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:52.568921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:52.569332 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:52.843596 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:36:52.844120 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:52.850612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:52.851149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:52.851548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:52.852510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:52.853026 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:52.853520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:52.877756 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lazy-loading 'flavor' on Instance uuid 16ba9256-6be0-49de-8c61-4454227a18c8 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:36:53.103029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7989a9b5-c69b-44e9-876b-114cf856d161 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/action" status: 202 len: 0 microversion: 2.20 time: 0.263377 Aug 31 04:36:53.103616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 128/237] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 04:36:52 2022] POST /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:36:53.108910 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:53.109602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:53.116089 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:53.116566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:53.116993 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:53.117665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:53.118107 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:53.118521 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:53.250620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:53.258664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cc735856-f088-44d3-9d85-62cbf116cf8f tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.153738 Aug 31 04:36:53.259262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 129/238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:53 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:53.263900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:53.264496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:53.270687 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:53.270912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:53.271379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:53.272060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:53.272503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:53.272924 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:53.405038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:53.428786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:53.434739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:53.435957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-908c6898-1bfa-4163-bd9f-78a229fb4f60 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.175788 Aug 31 04:36:53.439490 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 130/239] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:36:53 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:36:53.445092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:53.453343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:53.465505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:53.465986 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:53.466405 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:53.467122 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:53.467565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:53.467977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:53.622702 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-62ffdba5-c20d-4e49-b892-87ed94abbcfa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.069442 Aug 31 04:36:53.623670 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 110/240] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:36:52 2022] POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-volume_attachments => generated 194 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:36:53.680599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:53.700893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-97a62516-402f-4d7d-a889-d926e39c345f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.259492 Aug 31 04:36:53.701548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 131/241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:53 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:54.285020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:54.286386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:54.301452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.302152 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.302521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.303384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.303677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.304085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.463482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:54.464091 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:54.472111 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.472589 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.473440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.474155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.478840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:54.480378 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.482753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.487255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3ddac9f8-6c7a-4a7e-8b0f-5fafc32e2c06 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.211615 Aug 31 04:36:54.488312 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 111/242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:54 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:54.726321 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:54.735204 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:54.735204 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:54.735853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.736513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.737261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.738815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.742640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.743631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.745922 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:54.747376 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:54.748755 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4fac2d08-2d1c-4c46-8041-10dc4a7d74ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.289950 Aug 31 04:36:54.749421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 132/243] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:36:54 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:36:54.922358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:54.931047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9117c820-03be-4f26-980a-a3d532935e71 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1502 microversion: 2.1 time: 0.211330 Aug 31 04:36:54.931633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 112/244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:54 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:36:54.953605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2191dfa9-1214-4a57-a59a-2329b4ebe87e"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:36:54.956139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:54.962619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.963126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.963719 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.964403 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:54.964845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:54.965273 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:54.990897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] HTTP exception thrown: Cannot 'attach_volume' instance aaed2599-c3cc-4ac7-91be-29c314bf23cb while it is in vm_state rescued Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Request method failure captured: Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: POST /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb/os-volume_attachments HTTP/1.1 Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 74 Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTrfwyw_GXANrca7jvUZz8voquFELERhFjMKUTQbmsZdIr-U9Op7O8DXdpnmglE1E37_uLYT-651do0BZp05PUAmkKLgb-qOvVbhfqQ2XWXbWyged1pOKLifNivoza-T0j_wmOQW0HoQatXxOf2SCJVKKTIJtNEoaKEp4YWVOG3Yxk Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:36:54.992587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c02e60929267489cb181831f1ac578e4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c02e60929267489cb181831f1ac578e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}] Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 863e457bd6fd4bff82f552e63ca1034c Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {"volumeAttachment": {"volumeId": "2191dfa9-1214-4a57-a59a-2329b4ebe87e"}} Aug 31 04:36:54.993863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Cannot 'attach_volume' instance aaed2599-c3cc-4ac7-91be-29c314bf23cb while it is in vm_state rescued Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'server_id': 'aaed2599-c3cc-4ac7-91be-29c314bf23cb', 'body': {'volumeAttachment': {'volumeId': '2191dfa9-1214-4a57-a59a-2329b4ebe87e'}}} Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aaed2599-c3cc-4ac7-91be-29c314bf23cb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:36:54.994746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance aaed2599-c3cc-4ac7-91be-29c314bf23cb while it is in vm_state rescued Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:36:54.996083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:36:54.997355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:36:54.997355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:36:54.997355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance aaed2599-c3cc-4ac7-91be-29c314bf23cb while it is in vm_state rescued Aug 31 04:36:54.997355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:36:54.997355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Returning 409 to user: Cannot 'attach_volume' instance aaed2599-c3cc-4ac7-91be-29c314bf23cb while it is in vm_state rescued {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:36:54.997355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-444c5fd3-d036-44b3-a220-1943d2b20fbd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044668 Aug 31 04:36:54.997355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 133/245] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:36:54 2022] POST /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 04:36:55.002968 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:36:55.003497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:55.009562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.010018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.010455 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.011367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.011819 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.012233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.087267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ce4da12b-6f92-4951-b8dd-b1fd3cd7d732 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb/action" status: 202 len: 0 microversion: 2.1 time: 0.087979 Aug 31 04:36:55.087904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 113/246] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:36:54 2022] POST /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:36:55.096125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:55.096729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:55.103927 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.104488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.104916 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.105627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.106179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.106821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.257562 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:55.265480 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9e4366f4-2eb4-4c47-a137-a35cd805021a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1510 microversion: 2.1 time: 0.173250 Aug 31 04:36:55.266056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 134/247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:55 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:55.511815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:55.512574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:55.519392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.520536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.521014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.522243 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.522774 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.523527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.761325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:55.770871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-41aa1851-1df6-48c7-998b-c3a6d163740a tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.264711 Aug 31 04:36:55.771450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 114/248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:55 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:55.773050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:55.773647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:55.779591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.780066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.780484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.781166 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:55.781599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:55.782006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:55.941677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:55.951157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:55.952806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:55.954384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-47cc59c3-77a2-48b0-a1b6-1e45c84f664b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.185240 Aug 31 04:36:55.955300 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 135/249] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:36:55 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:36:56.287692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:56.288702 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:56.295306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:56.295788 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:56.296210 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:56.296888 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:56.297326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:56.297751 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:56.455345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:56.465173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c3708c85-7205-4604-83c2-9c4cb5af82ce tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1510 microversion: 2.1 time: 0.181699 Aug 31 04:36:56.466037 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 115/250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:56 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:56.791401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:56.792005 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:56.799652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:56.800335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:56.800758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:56.801551 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:56.802389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:56.803125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:56.936071 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:56.944198 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-88ce37a9-ad6d-4412-a650-2ba4e6250861 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.156610 Aug 31 04:36:56.944758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 136/251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:56 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:56.978666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:56.979306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:56.985867 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:56.986379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:56.986842 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:56.987524 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:56.987974 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:56.988391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:57.138600 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:57.147565 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:57.148999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:57.150172 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c5c62420-b8b3-4ece-929a-67a874aa9950 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.175521 Aug 31 04:36:57.150741 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 116/252] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:36:56 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:36:57.488282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:57.488869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:57.495451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:57.496003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:57.496481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:57.497260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:57.497788 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:57.498281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:57.677040 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:57.684816 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9df6400a-7dc9-4b55-9c8d-a9103182da2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1510 microversion: 2.1 time: 0.200470 Aug 31 04:36:57.685402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 137/253] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:57 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:57.964819 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:57.965420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:57.971296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:57.971788 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:57.972172 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:57.973467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:57.973865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:57.974288 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:58.123328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:58.136487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-578bbee4-cd76-449d-a910-967ec1fbc81e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.174967 Aug 31 04:36:58.137536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 117/254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:57 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:58.175658 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:58.179637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:58.186388 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:58.187034 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:58.187457 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:58.188138 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:58.188574 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:58.189125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:58.334633 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:58.343908 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:58.345638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:58.346969 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b874876e-a956-448a-819f-ce0b85956fa7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.176817 Aug 31 04:36:58.347547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 138/255] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:36:58 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:36:58.705397 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:58.705994 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:58.712227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:58.712682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:58.713103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:58.713775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:58.714214 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:58.714625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:58.846031 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:58.855489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-df61360c-b0e6-4907-b1ba-720d4c2890fb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1510 microversion: 2.1 time: 0.153893 Aug 31 04:36:58.856055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 118/256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:58 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:59.160763 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:59.162166 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:59.182789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:59.183371 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:59.183681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:59.184367 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:59.184803 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:59.185212 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:59.374493 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:59.375137 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:59.385792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:59.391598 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:59.391748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:59.392489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:59.392943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:59.393368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:59.486432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:59.496734 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-452d646f-14de-4dc8-b2b0-9c9cdc6a289b tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.340840 Aug 31 04:36:59.497343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 139/257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:59 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:36:59.703820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:59.715660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:59.718197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:36:59.720203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-03af94a3-77bc-4ea3-8bd4-6b9393a76771 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.350483 Aug 31 04:36:59.721543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 119/258] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:36:59 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:36:59.875578 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:36:59.876185 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:36:59.882306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:59.882813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:59.883244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:36:59.883928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:36:59.884379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:36:59.884795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:00.057850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:00.060393 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:00.071349 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-45d5259b-c969-4d3c-ac4d-d62de2bd6b2d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1510 microversion: 2.1 time: 0.199493 Aug 31 04:37:00.073325 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 140/259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:36:59 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:00.140944 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1741038022", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "networks": [{"uuid": "432503fc-5225-4e38-b2a8-672138c90cb1"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:00.193691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] validate_networks() for [('432503fc-5225-4e38-b2a8-672138c90cb1', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:37:00.529069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:00.529967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:00.539581 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:00.540506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:00.541086 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:00.542080 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:00.542921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:00.543536 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:00.626189 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:37:00.626930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:37:00.627631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:37:00.627631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:37:00.627932 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:37:00.637561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:00.638268 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:00.638885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:00.639758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:00.641281 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:00.642031 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:00.661552 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Getting quotas for project 52fbe77f79a5449b8fb2bfef82360b94. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:37:00.667032 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Getting quotas for user 503ba8b1d3f64186b188bed35c4baefe and project 52fbe77f79a5449b8fb2bfef82360b94. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:37:00.681784 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:37:00.684659 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:37:00.725633 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:00.733955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2d9957f8-1a37-4942-aaf6-f06a3359f8a3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.220275 Aug 31 04:37:00.740550 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e012c61-1390-42ee-8e2f-3d77685a3e7e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603338 Aug 31 04:37:00.741503 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 120/260] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:37:00.748684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 141/261] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:00 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:00.762111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:00.762746 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:00.765303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e7bf3c4e-d698-437b-9b95-95b0aac82727 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:00.766128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e7bf3c4e-d698-437b-9b95-95b0aac82727 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:00.770913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:00.771513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:00.772039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:00.772979 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:00.774415 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:00.775028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:00.870324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e7bf3c4e-d698-437b-9b95-95b0aac82727 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:00.877981 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e7bf3c4e-d698-437b-9b95-95b0aac82727 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1219 microversion: 2.1 time: 0.121729 Aug 31 04:37:00.878748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 142/262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:00 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:00.952870 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:00.955313 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:00.963986 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:00.965513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:00.966809 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3341eb65-c8a6-4e63-ad39-9880cd57d738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.223973 Aug 31 04:37:00.967533 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 121/263] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:00 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:01.092640 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:01.093305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:01.103077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.104188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.104870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:01.105754 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.106200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.106609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:01.264366 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:01.274577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-90900d4a-9e25-4e55-a434-bbee04041154 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1510 microversion: 2.1 time: 0.185594 Aug 31 04:37:01.276381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 143/264] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:01 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:01.472601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-0d4a85ba-e18d-4a47-bc3e-d1eec4573d31 req-9c0f5863-5b59-4e04-99d6-bb2103aa71b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48e5c2f-aa5d-4351-9309-c69f06b9131e", "name": "network-vif-plugged", "status": "completed", "tag": "d07fc2fb-c684-423c-9262-8b9678531baf"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:01.485230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0d4a85ba-e18d-4a47-bc3e-d1eec4573d31 req-9c0f5863-5b59-4e04-99d6-bb2103aa71b0 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.485767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0d4a85ba-e18d-4a47-bc3e-d1eec4573d31 req-9c0f5863-5b59-4e04-99d6-bb2103aa71b0 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.486181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0d4a85ba-e18d-4a47-bc3e-d1eec4573d31 req-9c0f5863-5b59-4e04-99d6-bb2103aa71b0 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:01.498993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-0d4a85ba-e18d-4a47-bc3e-d1eec4573d31 req-9c0f5863-5b59-4e04-99d6-bb2103aa71b0 service nova] Creating event network-vif-plugged:d07fc2fb-c684-423c-9262-8b9678531baf for instance f48e5c2f-aa5d-4351-9309-c69f06b9131e on hv-cinder-85530 Aug 31 04:37:01.504025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-0d4a85ba-e18d-4a47-bc3e-d1eec4573d31 req-9c0f5863-5b59-4e04-99d6-bb2103aa71b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035182 Aug 31 04:37:01.504611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 122/265] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:01.758242 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:01.759082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:01.765601 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.766107 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.766590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:01.767317 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.767729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.768171 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:01.900368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:01.901083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:01.903831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:01.907224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.907800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.908288 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:01.909081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.909584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.910058 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:01.918789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-851d1c06-c12f-4d75-9230-5fa47efe9dae tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.166341 Aug 31 04:37:01.919566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 144/266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:01 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:01.986114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:01.990121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:01.990743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:01.995088 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-464f9d32-be71-4609-ad2c-e0a790bbfab0 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1215 microversion: 2.1 time: 0.098597 Aug 31 04:37:01.995737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 123/267] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:01 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:01.998606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:01.999250 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:01.999750 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:02.000539 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:02.001230 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:02.001771 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:02.137861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:02.145990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:02.147593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:02.148740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9ea6d9a7-b218-498c-94c5-8e3f26d59e98 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.163114 Aug 31 04:37:02.149291 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 145/268] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:01 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:02.301961 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:02.302833 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:02.309497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:02.310210 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:02.310823 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:02.311675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:02.312302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:02.312731 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:02.512670 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:02.520428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eb9cc2fe-eef2-46d1-b5db-bb27886a4903 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1516 microversion: 2.1 time: 0.222585 Aug 31 04:37:02.521218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 124/269] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:02 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:02.941846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:02.942772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:02.951378 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:02.952013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:02.952632 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:02.953657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:02.954296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:02.954898 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:03.016862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:03.017583 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:03.024093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:03.024613 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:03.025110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:03.025835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:03.026283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:03.026695 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:03.088928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:03.093136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:03.100232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2c71d81e-4191-4c3b-a14c-a5a6d27460c9 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.163312 Aug 31 04:37:03.101002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 146/270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:02 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:03.101902 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-194de285-251c-42a2-84c7-68b5097c4a52 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1271 microversion: 2.1 time: 0.088909 Aug 31 04:37:03.102986 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 125/271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:03 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:03.179555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:03.180320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:03.186369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:03.186885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:03.187313 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:03.187991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:03.188432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:03.188844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:03.327117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:03.339650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:03.341802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:03.343637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-52944d41-ffa0-43d3-be38-d43878616fec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.168434 Aug 31 04:37:03.344365 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 147/272] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:03 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:03.892616 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-697e6891-75b2-451b-adbe-2e4390e2686a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'create', calling method: .version_select at 0x7fc8272d4f70>, body: {"keypair": {"name": "tempest-keypair-1906299075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFZoOLVO1nZjdjEgw8P/+3hFHSALXfMZb5G9SFypzNMIX0t7MxFTb8yQHbOOhF58iDGzSvV4vSCrMvoCmWdkA2ma6cEX6nFdhlRZV/32ehM8FGp4IMBZ91v5lF8SBXRlA=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:03.910222 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-697e6891-75b2-451b-adbe-2e4390e2686a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for project c02e60929267489cb181831f1ac578e4. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:37:03.915081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-697e6891-75b2-451b-adbe-2e4390e2686a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for user 863e457bd6fd4bff82f552e63ca1034c and project c02e60929267489cb181831f1ac578e4. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:37:03.941082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-697e6891-75b2-451b-adbe-2e4390e2686a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052301 Aug 31 04:37:03.941684 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 126/273] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:37:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:04.123136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:04.123731 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:04.124113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:04.124219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:04.130250 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:04.130747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:04.131369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:04.132142 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:04.132666 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:04.133182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:04.135085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:04.135623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:04.136065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:04.136873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:04.137457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:04.137911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:04.289448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:04.303086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-37fc8943-4329-4ef1-a379-97ebad2ecab7 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1271 microversion: 2.1 time: 0.182698 Aug 31 04:37:04.311358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 127/274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:04 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:04.324484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:04.360102 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-27d38e30-283e-4e04-b63f-fe4b1e88cc05 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1315 microversion: 2.1 time: 0.240804 Aug 31 04:37:04.360710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 148/275] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:04 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:04.371023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:04.372613 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:04.381154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:04.381686 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:04.382125 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:04.382887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:04.383357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:04.383772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:04.566217 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:04.577054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:04.579112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:04.580470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-abdd04f4-7f6b-4b15-98ba-7ee28148fc9e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.214815 Aug 31 04:37:04.581186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 128/276] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:04 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:05.325559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:05.326154 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:05.332532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.333006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.333763 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.334809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.335421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.336058 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.380480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:05.381120 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:05.387980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.388454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.388879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.389566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.390009 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.390422 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.408838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:05.417134 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4ed3cb65-99b8-4fbb-8590-85d2c849e82a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1289 microversion: 2.1 time: 0.096067 Aug 31 04:37:05.418474 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 149/277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:05 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:05.529658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:05.541680 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eae9caf1-5006-4858-89ff-3f76e6e0ef9d tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1463 microversion: 2.1 time: 0.164931 Aug 31 04:37:05.542234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 129/278] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:05 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:05.613932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:05.613932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:05.619026 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:05.619539 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:05.622901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.623610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.624244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.626235 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.626962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.627578 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.630168 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.630625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.631068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.631761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:05.632200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:05.632610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:05.730021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:37:05.951508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:05.962514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:05.962735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a21c98b0-53b6-454e-ad8e-56587cdacf8e tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 204 len: 0 microversion: 2.1 time: 0.346627 Aug 31 04:37:05.963973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:05.965522 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-91349753-a955-4cbe-bed1-eaacfde9bd73 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.356319 Aug 31 04:37:05.967121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 130/279] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:37:05 2022] DELETE /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:37:05.979973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 150/280] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:05 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:05.982055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:05.982873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:06.000593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:06.001441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:06.002187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:06.003281 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:06.003903 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:06.004635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:06.044999 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1348479555", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2813bab1-8e5c-4bae-a18b-804fcb1fb44c"}], "security_groups": [{"name": "tempest-securitygroup--491418661"}], "key_name": "tempest-keypair-1906299075", "user_data": "}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:06.175352 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] validate_networks() for [('2813bab1-8e5c-4bae-a18b-804fcb1fb44c', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:37:06.547146 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:06.556421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-183768c5-0b6d-43f9-90dc-fbd5a0d699c7 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1469 microversion: 2.1 time: 0.587222 Aug 31 04:37:06.557010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 131/281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:05 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:06.561873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:06.562658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:06.569306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:06.570076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:06.570687 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:06.571693 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:06.572512 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:06.573233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:06.638263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:37:06.638785 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:37:06.639246 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:37:06.640421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:37:06.640985 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:37:06.650407 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:06.650856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:06.651265 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:06.652726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:06.653377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:06.654257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:06.686612 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:06.697187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for project c02e60929267489cb181831f1ac578e4. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:37:06.700569 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5605a50b-c2cd-4773-8860-497893e238ef tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1277 microversion: 2.1 time: 0.142250 Aug 31 04:37:06.701328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 132/282] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:06 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1277 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:06.705681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Getting quotas for user 863e457bd6fd4bff82f552e63ca1034c and project c02e60929267489cb181831f1ac578e4. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:37:06.723934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:37:06.726655 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:37:06.792983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-428796f0-40d2-4a5b-8748-340a81633a35 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.751727 Aug 31 04:37:06.794155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 151/283] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:37:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:37:06.797052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5e182f24-1078-48c7-b07e-a2b845734482 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:06.804758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e182f24-1078-48c7-b07e-a2b845734482 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:06.805701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e182f24-1078-48c7-b07e-a2b845734482 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:06.806600 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e182f24-1078-48c7-b07e-a2b845734482 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:06.809002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-966f3c07-54fd-4587-8465-09c4eed86512 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:06.809698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-966f3c07-54fd-4587-8465-09c4eed86512 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:06.907706 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5e182f24-1078-48c7-b07e-a2b845734482 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Going to try to stop instance {{(pid=127198) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 04:37:06.922436 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-966f3c07-54fd-4587-8465-09c4eed86512 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:06.936089 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-966f3c07-54fd-4587-8465-09c4eed86512 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1246 microversion: 2.1 time: 0.132535 Aug 31 04:37:06.936975 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 152/284] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:06 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1246 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:06.990232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:06.991095 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:07.000136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.001024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.001872 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.002974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.003599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.004462 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.024940 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5e182f24-1078-48c7-b07e-a2b845734482 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action" status: 202 len: 0 microversion: 2.1 time: 0.231021 Aug 31 04:37:07.030025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 133/285] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:37:06 2022] POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 04:37:07.054592 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:07.055345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:07.089508 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.090224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.090951 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.091861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.092496 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.093124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.235431 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:07.246989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:07.249198 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:07.250906 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-05077db7-4c60-409d-8066-f42c4aa0225f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.265851 Aug 31 04:37:07.252431 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 153/286] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:06 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:07.351832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:07.360629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e5a19761-1f63-4288-9bfc-f5fe2ac722fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.325217 Aug 31 04:37:07.375514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 134/287] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:07 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:07.579138 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:07.580000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:07.582144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:07.587562 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.587786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.588374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.589069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.590022 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.590510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.722578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:07.726044 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:07.733999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.734524 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.735264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.736272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.737203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.737770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.748453 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:07.756807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-edfaa960-46b7-45e1-a895-b65a69269b97 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1469 microversion: 2.1 time: 0.181714 Aug 31 04:37:07.757377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 154/288] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:07 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:07.957658 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:07.958767 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:07.965819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.966452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.966939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:07.967831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:07.968639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:07.969222 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.002928 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:08.016795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0174ca6a-fa1a-41a3-884d-d7eecdbf4c57 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.299382 Aug 31 04:37:08.018226 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 135/289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:07 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:08.064827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:08.084514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b375e3bc-4caf-4d4d-bcd2-17053d557387 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1250 microversion: 2.1 time: 0.130485 Aug 31 04:37:08.099098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 155/290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:07 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1250 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:08.288560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:08.291136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:08.298481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:08.299334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:08.299972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.300951 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:08.301663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:08.303165 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.393579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:08.394697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:08.418187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:08.418756 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:08.420047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.420761 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:08.421395 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:08.421627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.664397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:08.678839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b6dc5be8-5300-48c3-bf16-025c94d0991d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.299959 Aug 31 04:37:08.681471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 156/291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:08 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:08.694676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-11684979-14a9-457e-9d20-4f99d8c007b1 req-17b6a38f-170e-430a-94b6-fa8f3090dc0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bafbd2f-51ff-419e-995e-c8455ecd93a7", "tag": "d12da23d-d2c9-4b91-bbfc-4cc391e994f7"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:08.716218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-11684979-14a9-457e-9d20-4f99d8c007b1 req-17b6a38f-170e-430a-94b6-fa8f3090dc0d service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:08.716710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-11684979-14a9-457e-9d20-4f99d8c007b1 req-17b6a38f-170e-430a-94b6-fa8f3090dc0d service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:08.717271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-11684979-14a9-457e-9d20-4f99d8c007b1 req-17b6a38f-170e-430a-94b6-fa8f3090dc0d service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.722277 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:08.733171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:08.734546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-11684979-14a9-457e-9d20-4f99d8c007b1 req-17b6a38f-170e-430a-94b6-fa8f3090dc0d service nova] Creating event network-changed:d12da23d-d2c9-4b91-bbfc-4cc391e994f7 for instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 on hv-cinder-85530 Aug 31 04:37:08.735854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:08.737259 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a1859f2c-ab2d-45fd-9382-a42ef44de5bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.454156 Aug 31 04:37:08.738284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 136/292] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:08 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:08.741386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-11684979-14a9-457e-9d20-4f99d8c007b1 req-17b6a38f-170e-430a-94b6-fa8f3090dc0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057539 Aug 31 04:37:08.742200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 157/293] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:08.780766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:08.781799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:08.788681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:08.789433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:08.790143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.791069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:08.791737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:08.792525 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:08.810311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:09.039885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:09.040750 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:09.048420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.048903 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.049299 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:09.050003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.050553 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.050939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:09.106090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:09.118802 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-acf3e65f-1406-4add-8275-481c45623d71 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1469 microversion: 2.1 time: 0.341826 Aug 31 04:37:09.123747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 137/294] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:08 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:09.143475 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:09.146247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:09.159420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.159990 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.160481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:09.161251 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.161796 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.162642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:09.298448 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:09.318377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:09.327590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7c9a5252-7842-4981-8c8f-9ee7930c9ae9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1298 microversion: 2.1 time: 0.202442 Aug 31 04:37:09.329472 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-19cb2374-5de7-4552-b90d-efaa0ba21955 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.294303 Aug 31 04:37:09.332630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 158/295] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:09 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:09.333402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 138/296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:09 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:09.705739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:09.706347 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:09.716053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.716542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.717049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:09.717859 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.718323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.719159 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:09.771311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:09.772257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:09.810367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.811076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.811535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:09.812907 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:09.813789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:09.813789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.109263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:10.118427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:10.120091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:10.121658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-92cbf3bd-7ab2-4c15-8714-8340d1e925d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.363681 Aug 31 04:37:10.122808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 139/297] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:09 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:10.149259 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:10.149854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:10.153690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:10.158391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.159470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.159916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.160604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.161328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.162042 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.179603 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:10.190819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-17bd768f-8e29-4c6d-a175-dca58e21eb21 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.489717 Aug 31 04:37:10.192282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 159/298] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:09 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:10.214709 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.215223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.215647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.216086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lazy-loading 'fault' on Instance uuid f48e5c2f-aa5d-4351-9309-c69f06b9131e {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:37:10.287129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:10.296055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8a77df57-215e-42f9-9c53-630bdadf2447 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1305 microversion: 2.1 time: 0.151841 Aug 31 04:37:10.296636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 140/299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:10 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1305 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:10.355147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:10.355844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:10.362916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:10.362916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:10.368467 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.368942 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.369621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.370368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.371015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.372304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.377896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.378492 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.379161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.380211 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.380799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.381323 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.509438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:10.517267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fecb9a9c-2d3f-4a29-b53e-4cb93349a650 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1304 microversion: 2.1 time: 0.161466 Aug 31 04:37:10.517862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 141/300] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:10 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:10.556473 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:10.559319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:10.568205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-69a52837-db70-4d62-b07e-91f0b5afe7cb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.216849 Aug 31 04:37:10.569145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 160/301] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:10 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:10.761056 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6db17961-f7dd-407f-96e2-7bcf9e866831 req-683d1cfa-714e-4618-8588-15c29d8d18f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48e5c2f-aa5d-4351-9309-c69f06b9131e", "name": "network-vif-deleted", "tag": "d07fc2fb-c684-423c-9262-8b9678531baf"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:10.766122 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:10.773508 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6db17961-f7dd-407f-96e2-7bcf9e866831 req-683d1cfa-714e-4618-8588-15c29d8d18f6 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:10.774128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6db17961-f7dd-407f-96e2-7bcf9e866831 req-683d1cfa-714e-4618-8588-15c29d8d18f6 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:10.774395 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6db17961-f7dd-407f-96e2-7bcf9e866831 req-683d1cfa-714e-4618-8588-15c29d8d18f6 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:10.785539 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6db17961-f7dd-407f-96e2-7bcf9e866831 req-683d1cfa-714e-4618-8588-15c29d8d18f6 service nova] Creating event network-vif-deleted:d07fc2fb-c684-423c-9262-8b9678531baf for instance f48e5c2f-aa5d-4351-9309-c69f06b9131e on hv-cinder-85530 Aug 31 04:37:10.791411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6db17961-f7dd-407f-96e2-7bcf9e866831 req-683d1cfa-714e-4618-8588-15c29d8d18f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035261 Aug 31 04:37:10.792033 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 142/302] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:11.147723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:11.148500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:11.154958 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.155634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.156183 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.156870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.157310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.157722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.215858 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:11.217114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:11.228473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.229207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.231172 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.232291 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.233142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.234052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.338241 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:11.365373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:11.367861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:11.369588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-dc545892-ff9b-4484-a5d8-02204d96f509 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.227794 Aug 31 04:37:11.370904 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 161/303] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:11 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:11.377328 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:11.378834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:11.386332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.387463 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.388720 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.389678 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.390402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.390860 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.432021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.432231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.434174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.434174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lazy-loading 'fault' on Instance uuid f48e5c2f-aa5d-4351-9309-c69f06b9131e {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:37:11.531302 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294d5d11423c4d2bad05afacdd999995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd3f85755d4deea3fc0192c1cbbc4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:11.560484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e9d1e9d5-d33c-4c56-9ae1-cd53a374e2c5 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 200 len: 1305 microversion: 2.1 time: 0.186967 Aug 31 04:37:11.562148 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 162/304] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:11 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 1305 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:11.580416 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:11.582317 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:11.604636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.605671 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.606371 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.607566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.608187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.608857 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.627888 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:11.652939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0a807e43-7158-4139-a661-a56b0e64684a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.442908 Aug 31 04:37:11.654359 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 143/305] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:11 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:11.671066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:11.674392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:11.726940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:11.732218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.732921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.733571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.737133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c6c5f99c-ff7c-4d8c-a80f-50073ba2ed0f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1304 microversion: 2.1 time: 0.169071 Aug 31 04:37:11.738019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 163/306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:11 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:11.751221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:11.753485 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-231033449", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "networks": [{"uuid": "aa427dea-fb3a-4e27-9187-8436fa27cc39"}]}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:11.754268 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:11.754706 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:11.853944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] validate_networks() for [('aa427dea-fb3a-4e27-9187-8436fa27cc39', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:37:12.312770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:12.314576 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:37:12.315021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:37:12.315586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:37:12.315887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:37:12.316293 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:37:12.330756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4a76b788-1146-41c7-957a-a81765f12dda tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.670624 Aug 31 04:37:12.333849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.334532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.351586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 144/307] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:11 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:12.351842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.351842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.351842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.351842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.377604 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Getting quotas for project b35a44f3c0ba4230bac2bcb9d4e8ec08. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:37:12.382492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Getting quotas for user fffc906c79ba418cbc52e5db5ca991ca and project b35a44f3c0ba4230bac2bcb9d4e8ec08. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:37:12.396489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:12.397418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:12.405534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.406245 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.406927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.408765 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.409426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.410041 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.416629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:37:12.420810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:37:12.527194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-831e4c94-7813-4a8a-a892-ecdc4a778801 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787990 Aug 31 04:37:12.531525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 164/308] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:37:12.542548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e9587b05-ba58-460b-bd4d-bcb59a7bc124 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:12.543213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e9587b05-ba58-460b-bd4d-bcb59a7bc124 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:12.643610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e9587b05-ba58-460b-bd4d-bcb59a7bc124 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:12.655289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e9587b05-ba58-460b-bd4d-bcb59a7bc124 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1213 microversion: 2.1 time: 0.112723 Aug 31 04:37:12.655974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 165/309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:12 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:12.662748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:12.663426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] [instance: f48e5c2f-aa5d-4351-9309-c69f06b9131e] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:12.676352 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.676841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.677363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.678098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.678538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.679180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.699397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] HTTP exception thrown: Instance f48e5c2f-aa5d-4351-9309-c69f06b9131e could not be found. Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Request method failure captured: Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e HTTP/1.1 Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuVVgo83bn0W-xG46VJ8Gp12pdk8dngZFIbYT-LxHQW7kL7RzlZiQm053W0LBI_Bgko5czFzBqOvtyDDuN6Hf8MY9yWAKlBhCebqu_ONnrGw0TRbduOr0zuuBGr7fUsE-cVehkGjmmghWXGpNckeOfU7Urv6lAovmG32mb7r-J2c5D4 Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 80dd3f85755d4deea3fc0192c1cbbc4b Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-VolumesNegativeTest-875315383 Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:37:12.702812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/80dd3f85755d4deea3fc0192c1cbbc4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_80dd3f85755d4deea3fc0192c1cbbc4b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/80dd3f85755d4deea3fc0192c1cbbc4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/80dd3f85755d4deea3fc0192c1cbbc4b"}]}] Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-VolumesNegativeTest-875315383 Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 80dd3f85755d4deea3fc0192c1cbbc4b Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-VolumesNegativeTest-875315383 Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-VolumesNegativeTest-875315383-project Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 294d5d11423c4d2bad05afacdd999995 Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-VolumesNegativeTest-875315383-project Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance f48e5c2f-aa5d-4351-9309-c69f06b9131e could not be found. Aug 31 04:37:12.704065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': 'f48e5c2f-aa5d-4351-9309-c69f06b9131e'} Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48e5c2f-aa5d-4351-9309-c69f06b9131e could not be found. Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:37:12.704784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48e5c2f-aa5d-4351-9309-c69f06b9131e could not be found. Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48e5c2f-aa5d-4351-9309-c69f06b9131e could not be found. Aug 31 04:37:12.705928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:12.707049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] Returning 404 to user: Instance f48e5c2f-aa5d-4351-9309-c69f06b9131e could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:37:12.707049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-01d4c0dc-536e-46fc-bf4e-cb6721d627b3 tempest-VolumesNegativeTest-875315383 tempest-VolumesNegativeTest-875315383-project] 10.222.0.42 "GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e" status: 404 len: 111 microversion: 2.1 time: 0.047251 Aug 31 04:37:12.707049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 166/310] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:12 2022] GET /compute/v2.1/servers/f48e5c2f-aa5d-4351-9309-c69f06b9131e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:37:12.711296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:12.712066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:12.720147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.720640 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.721065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.722002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.722552 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.722998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.813575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:12.825324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:12.831022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:12.832813 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4538b6f0-0617-4a23-86ac-73e3ac0f028f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.441748 Aug 31 04:37:12.835143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 145/311] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:12 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:12.874300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:12.879233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:12.898608 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.899287 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.899904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.900910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:12.901531 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:12.902175 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:12.995831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:13.005533 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ce305710-b9ee-43d1-afe2-df1142a8dd98 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.298778 Aug 31 04:37:13.018137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 167/312] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:12 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:13.222616 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:13.240252 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e216bca8-84be-45df-9556-f80311a8417b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.401780 Aug 31 04:37:13.241472 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 146/313] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:12 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:13.358238 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:13.359085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:13.367732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:13.370001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:13.371212 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:13.373631 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:13.374890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:13.375706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:13.555905 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:13.565790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4d545788-72e0-4e0c-bbba-b8d92fe3d257 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.211625 Aug 31 04:37:13.566691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 168/314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:13 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:13.676350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:13.677113 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:13.697691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:13.702262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:13.704408 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:13.705365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:13.705837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:13.706265 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:13.810983 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:13.819859 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-af9326be-82b0-4050-8cc1-5604c73f77ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1265 microversion: 2.1 time: 0.147343 Aug 31 04:37:13.820560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 147/315] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:13 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:13.861684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:13.862324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:13.870990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:13.871617 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:13.872434 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:13.873771 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:13.874427 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:13.875216 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:13.910817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-13a7cca4-811a-4060-a567-805bdc4cde89 req-99d95545-4033-4ebe-9b70-1e7fad2d9dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543cfc4e-7580-4e55-999c-9bb37cbfca94", "tag": "1f8c2e75-3b33-4b6c-927f-d08d1ef62c56"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:13.924171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=10 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:13.947209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-13a7cca4-811a-4060-a567-805bdc4cde89 req-99d95545-4033-4ebe-9b70-1e7fad2d9dd3 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:13.947701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-13a7cca4-811a-4060-a567-805bdc4cde89 req-99d95545-4033-4ebe-9b70-1e7fad2d9dd3 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:13.951520 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-13a7cca4-811a-4060-a567-805bdc4cde89 req-99d95545-4033-4ebe-9b70-1e7fad2d9dd3 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:13.984862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-13a7cca4-811a-4060-a567-805bdc4cde89 req-99d95545-4033-4ebe-9b70-1e7fad2d9dd3 service nova] Creating event network-changed:1f8c2e75-3b33-4b6c-927f-d08d1ef62c56 for instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 on hv-cinder-85530 Aug 31 04:37:13.996121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-13a7cca4-811a-4060-a567-805bdc4cde89 req-99d95545-4033-4ebe-9b70-1e7fad2d9dd3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096646 Aug 31 04:37:13.997288 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 148/316] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:37:14.032635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:14.033829 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:14.048931 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.049652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.050420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.051848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.053285 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.053977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.124088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:14.132699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:14.134110 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:14.135313 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9e38614a-10aa-440c-b907-44965f8c22a7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.278001 Aug 31 04:37:14.136703 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 169/317] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:13 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:14.265559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:14.266213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:14.273385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.274064 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.274664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.275701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.276285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.276952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.380963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:14.393571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fddc69f0-65bd-4325-a8b0-82b93cb05907 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.369875 Aug 31 04:37:14.394410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 149/318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:14 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:14.500796 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:14.512213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b38a8d29-2897-4f15-8879-4680a0b5d807 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.252472 Aug 31 04:37:14.513616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 170/319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:14 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:14.588132 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:14.588618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:14.595003 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.595486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.595910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.596717 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.597163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.597764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.753068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:14.765219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-01130cad-1672-4ce2-9d92-da4bfd01f394 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.181127 Aug 31 04:37:14.766069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 150/320] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:14 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:14.845255 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:14.845872 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:14.853215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.858848 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.863068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.864021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:14.865375 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:14.865998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:14.976056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:14.985078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-28d8ba55-5be7-41a9-9a8d-7c28ac805261 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1273 microversion: 2.1 time: 0.143988 Aug 31 04:37:14.985614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 171/321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:14 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:15.160335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:15.161102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:15.170839 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.171338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.171767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.173689 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.174158 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.420382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:15.430111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:15.432250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:15.433155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:15.433832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dec6c2d4-5d03-4025-9d40-041abf37c5bb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1744 microversion: 2.20 time: 0.278913 Aug 31 04:37:15.434562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 151/322] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:15 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1744 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:15.443862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:15.460949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.465239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.467012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.467949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.468591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.469358 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.508126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-ea10815f-fd43-4c81-a3c6-fe62b64988be req-0294e4fd-4e2c-4036-a173-7bd892423dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bafbd2f-51ff-419e-995e-c8455ecd93a7", "name": "network-vif-plugged", "status": "completed", "tag": "d12da23d-d2c9-4b91-bbfc-4cc391e994f7"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:15.524549 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ea10815f-fd43-4c81-a3c6-fe62b64988be req-0294e4fd-4e2c-4036-a173-7bd892423dd9 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.525109 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ea10815f-fd43-4c81-a3c6-fe62b64988be req-0294e4fd-4e2c-4036-a173-7bd892423dd9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.525637 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ea10815f-fd43-4c81-a3c6-fe62b64988be req-0294e4fd-4e2c-4036-a173-7bd892423dd9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.563045 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-ea10815f-fd43-4c81-a3c6-fe62b64988be req-0294e4fd-4e2c-4036-a173-7bd892423dd9 service nova] Creating event network-vif-plugged:d12da23d-d2c9-4b91-bbfc-4cc391e994f7 for instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 on hv-cinder-85530 Aug 31 04:37:15.578244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-ea10815f-fd43-4c81-a3c6-fe62b64988be req-0294e4fd-4e2c-4036-a173-7bd892423dd9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073736 Aug 31 04:37:15.579135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 152/323] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:15.597371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:15.598897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:15.605943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.606623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.607085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.610550 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.611289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.612042 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.694584 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:15.704579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2cd4cd92-056c-41a3-b147-f84a121088a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.292437 Aug 31 04:37:15.705141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 172/324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:15 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:15.787088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:15.788138 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:15.794587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.795091 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.795513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.796197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:15.796632 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:15.797039 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:15.894379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:15.903224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c73630f3-dee2-4941-94f4-265c1f8d14e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.322904 Aug 31 04:37:15.907478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 153/325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:15 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:15.947638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:15.955941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ff938b06-8321-4cab-bd7f-f975d8422b05 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.173960 Aug 31 04:37:15.957078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 173/326] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:15 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:16.009728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:16.010906 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:16.030147 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.034432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.035104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:16.035942 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.038179 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.038179 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:16.190855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:16.202312 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bcaba19d-e757-4424-9e30-4c5b18ca9ba2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.197113 Aug 31 04:37:16.203652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 154/327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:16 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:16.457482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:16.458104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:16.466932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.467410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.467832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:16.468510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.468950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.469357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:16.623510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:16.633038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:16.634553 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:16.635721 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8cb52fa7-464c-44b0-a4fd-837da5139290 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1744 microversion: 2.20 time: 0.182225 Aug 31 04:37:16.636271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 174/328] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:16 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:16.728886 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:16.729557 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:16.737124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.737229 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.737633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:16.739430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.739430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.739430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:16.928202 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:16.929389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:16.937525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.938223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.938939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:16.940190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:16.940821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:16.941683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:17.043684 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:17.047936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:17.057626 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-78d7c7f0-c728-422f-9296-9e73f989cff0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.332573 Aug 31 04:37:17.058473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 155/329] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:16 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:17.083150 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:17.084715 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:17.093418 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:17.100565 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:17.101451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:17.102325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:17.102609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-716b2998-5ed6-4f0f-af78-a74d1ba7680b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.179093 Aug 31 04:37:17.103221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 175/330] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:16 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:17.103752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:17.104554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:17.105205 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:17.237453 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:17.238042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:17.252508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:17.252991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:17.253414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:17.254100 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:17.254729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:17.255147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:17.397226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:17.405483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5c7763f0-1797-4011-b17d-302ed4b9b067 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.172172 Aug 31 04:37:17.406260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 176/331] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:17 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:17.659007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:17.659611 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:17.666145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:17.666631 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:17.667096 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:17.667841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:17.668466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:17.669591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:17.751073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:17.764857 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7702e9d3-476a-4ddc-ac93-2b2a3a7c2b0b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.704711 Aug 31 04:37:17.765424 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 156/332] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:17 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:17.839479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:17.851003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:17.854786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:17.856023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5b767c0f-e6b4-4fb7-bdab-b807b90a25b7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1744 microversion: 2.20 time: 0.201279 Aug 31 04:37:17.875845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 177/333] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:17 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:18.082089 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:18.082817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:18.089039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.089530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.090016 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.090710 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.091197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.091617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.128780 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:18.129398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:18.141789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.142270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.142690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.143402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.143856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.144261 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.278452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:18.289377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:18.298220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-94c3cee1-f84d-4f06-8f43-74ee9e4f9b56 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.220047 Aug 31 04:37:18.303690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 157/334] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:18 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:18.304112 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ab034ed4-0893-47a3-9cc0-f056462c10fc tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.179878 Aug 31 04:37:18.304676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 178/335] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:18 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:18.323151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-13547ba5-1cb8-4eef-ad99-741bd44ca6f2 req-1a7a7431-2474-4308-b4e8-64063d7aabc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ff7d85-b143-4922-a7a6-e138c68737b8", "tag": "d4846db7-f9a0-42ba-82e1-3147a7af8fc3"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:18.332729 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-13547ba5-1cb8-4eef-ad99-741bd44ca6f2 req-1a7a7431-2474-4308-b4e8-64063d7aabc5 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.333202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-13547ba5-1cb8-4eef-ad99-741bd44ca6f2 req-1a7a7431-2474-4308-b4e8-64063d7aabc5 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.333827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-13547ba5-1cb8-4eef-ad99-741bd44ca6f2 req-1a7a7431-2474-4308-b4e8-64063d7aabc5 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.347037 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-13547ba5-1cb8-4eef-ad99-741bd44ca6f2 req-1a7a7431-2474-4308-b4e8-64063d7aabc5 service nova] Creating event network-changed:d4846db7-f9a0-42ba-82e1-3147a7af8fc3 for instance a0ff7d85-b143-4922-a7a6-e138c68737b8 on hv-cinder-85530 Aug 31 04:37:18.358553 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-13547ba5-1cb8-4eef-ad99-741bd44ca6f2 req-1a7a7431-2474-4308-b4e8-64063d7aabc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039076 Aug 31 04:37:18.359197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 158/336] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:18.428434 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:18.429176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:18.435974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.436706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.437567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.438450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.439025 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.439452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.457261 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:18.589064 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:18.597149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-029092af-4d60-478c-9a5f-00552bb83575 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.174576 Aug 31 04:37:18.597711 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 179/337] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:18 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:18.787266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:18.788312 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:18.795082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.795721 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.796336 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.797029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.797470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.798094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.883478 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:18.884740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:18.945809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.948067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:18.950162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.950629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.954563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:18.955177 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:18.955679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:18.959153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b31dbf92-e72c-4f15-8bb5-d21f0ebd02af tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1319 microversion: 2.1 time: 0.177145 Aug 31 04:37:18.960234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 159/338] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:18 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:19.139857 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:19.148400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:19.149823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:19.151007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-16281c68-de1c-4d8a-b740-85222697d8d1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.273273 Aug 31 04:37:19.151545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 180/339] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:18 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:19.325848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:19.326565 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:19.327413 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:19.330110 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:19.333790 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:19.334447 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:19.335271 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:19.336156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:19.336748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:19.337306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:19.337980 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:19.338535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:19.339225 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:19.340006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:19.340557 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:19.341297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:19.608330 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:19.622810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bdc38462-5d7f-48be-ac28-70792f59594b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.299636 Aug 31 04:37:19.625180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 181/340] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:19 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:19.639653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:19.642915 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:19.658160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:19.659121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:19.664237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:19.664667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:19.665140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:19.665614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:19.666225 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:19.681528 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a1d15f6f-de93-4ce0-9171-a8e4ce4ec358 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.357579 Aug 31 04:37:19.682607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 160/341] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:19 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:19.849725 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-bfbba7b3-2bc4-4c12-9876-ad74fe61c0d1 req-d1d52322-a1cd-4438-a0ab-fd97de726552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ba9256-6be0-49de-8c61-4454227a18c8", "name": "network-vif-plugged", "status": "completed", "tag": "f3809b0b-8437-4e98-88a3-a530ac0d92f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:19.868616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:19.878770 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-66080b64-1b74-4b0a-a708-7f4c81448656 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.251741 Aug 31 04:37:19.891382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-bfbba7b3-2bc4-4c12-9876-ad74fe61c0d1 req-d1d52322-a1cd-4438-a0ab-fd97de726552 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:19.891382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-bfbba7b3-2bc4-4c12-9876-ad74fe61c0d1 req-d1d52322-a1cd-4438-a0ab-fd97de726552 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:19.891382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-bfbba7b3-2bc4-4c12-9876-ad74fe61c0d1 req-d1d52322-a1cd-4438-a0ab-fd97de726552 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:19.894979 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 182/342] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:19 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:19.903427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-bfbba7b3-2bc4-4c12-9876-ad74fe61c0d1 req-d1d52322-a1cd-4438-a0ab-fd97de726552 service nova] Creating event network-vif-plugged:f3809b0b-8437-4e98-88a3-a530ac0d92f8 for instance 16ba9256-6be0-49de-8c61-4454227a18c8 on hv-cinder-85530 Aug 31 04:37:19.908554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-bfbba7b3-2bc4-4c12-9876-ad74fe61c0d1 req-d1d52322-a1cd-4438-a0ab-fd97de726552 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070657 Aug 31 04:37:19.909686 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 161/343] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:37:19.980826 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:19.982656 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:20.004528 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.008203 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.008729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:20.011910 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.012722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.013465 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:20.174018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:20.174735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:20.186215 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.186701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.187157 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:20.187853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.191136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.195218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:20.245748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:20.259190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6ad5363d-70b7-4104-92ac-b6de85582dc8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1508 microversion: 2.1 time: 0.282514 Aug 31 04:37:20.259768 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 183/344] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:19 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:20.645439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:20.646387 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:20.655898 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.657966 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.659137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:20.663544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.665680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.667973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:20.763320 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:20.774890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:20.783354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:20.786112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5f147390-58b1-4dad-90e7-9af054570dc8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.616255 Aug 31 04:37:20.786738 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 162/345] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:20 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:20.805272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:20.806170 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:20.825547 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.826054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.826495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:20.827330 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:20.827784 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:20.828208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:21.123251 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:21.130666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-aafc4d0d-5c33-459c-b1de-f5586c9962ec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.337758 Aug 31 04:37:21.131364 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 163/346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:20 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:21.147634 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:21.148266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:21.157864 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:21.157864 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:21.159246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:21.161230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:21.162891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:21.163707 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:21.266382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:21.285930 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1d492252-384a-48e5-bb7a-1813bae4b9a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.644616 Aug 31 04:37:21.306329 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 184/347] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:20 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:21.540200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:21.560546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b06325c1-f3ae-4c0b-9c7e-440cde96b19a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.427904 Aug 31 04:37:21.565682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 164/348] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:21 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:21.810155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:21.811268 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:21.825210 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:21.828409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:21.833949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:21.834978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:21.835603 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:21.836211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.120914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:22.132966 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:22.134597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:22.135996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-48f699ad-c2ce-48c8-933e-dc344eff375c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.330300 Aug 31 04:37:22.137914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 185/349] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:21 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:22.159621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:22.161085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:22.168923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:22.169599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:22.170185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.171076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:22.171968 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:22.172534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.323803 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:22.325427 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:22.332580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:22.333300 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:22.334350 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.335551 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:22.336203 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:22.337256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.358898 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=4 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:22.593893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:22.605514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-00219e16-7224-4040-92f3-1f61d6e5206c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.285519 Aug 31 04:37:22.606431 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 186/350] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:22 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:22.632198 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-cf7651c7-967a-4c0f-8fcb-61f84984c981 req-6a87607c-2a55-457d-9bca-8f1943b4f13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543cfc4e-7580-4e55-999c-9bb37cbfca94", "name": "network-vif-plugged", "status": "completed", "tag": "1f8c2e75-3b33-4b6c-927f-d08d1ef62c56"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:22.649733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=18 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:22.665074 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-cf7651c7-967a-4c0f-8fcb-61f84984c981 req-6a87607c-2a55-457d-9bca-8f1943b4f13f service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:22.666054 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-cf7651c7-967a-4c0f-8fcb-61f84984c981 req-6a87607c-2a55-457d-9bca-8f1943b4f13f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:22.667196 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-cf7651c7-967a-4c0f-8fcb-61f84984c981 req-6a87607c-2a55-457d-9bca-8f1943b4f13f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.705400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-cf7651c7-967a-4c0f-8fcb-61f84984c981 req-6a87607c-2a55-457d-9bca-8f1943b4f13f service nova] Creating event network-vif-plugged:1f8c2e75-3b33-4b6c-927f-d08d1ef62c56 for instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 on hv-cinder-85530 Aug 31 04:37:22.721323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-cf7651c7-967a-4c0f-8fcb-61f84984c981 req-6a87607c-2a55-457d-9bca-8f1943b4f13f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112181 Aug 31 04:37:22.723084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 187/351] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:22.736051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:22.736755 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:22.752558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:22.753041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:22.753462 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.755385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:22.755991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:22.756411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:22.768651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:22.784353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d5620b3-e7b9-41f4-9ef4-313c8c90f6e9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.631753 Aug 31 04:37:22.790007 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 165/352] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:22 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:23.063798 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:23.077701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-987ee211-cc6a-4167-9283-ba67d0db367a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.352132 Aug 31 04:37:23.077991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 188/353] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:22 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:23.163871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:23.164555 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:23.181703 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:23.183497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:23.184612 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:23.186039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:23.186817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:23.187467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:23.551524 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:23.560709 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:23.562130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:23.563349 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a76e2303-b1db-4e31-a492-2d5e0feb48ac tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.404126 Aug 31 04:37:23.575181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 166/354] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:23 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:23.640278 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:23.640920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:23.647097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:23.647566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:23.648126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:23.649056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:23.649685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:23.650287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:23.811527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:23.812365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:23.821516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:23.824171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:23.826001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:23.827009 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:23.829311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:23.830037 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:23.890218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:23.902880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3ea4a414-4ec1-4493-9b5b-3d2085f749fa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.269485 Aug 31 04:37:23.919176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 189/355] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:23 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:24.102294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:24.103392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:24.112245 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:24.114044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:24.115390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:24.116546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:24.117234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:24.118021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:24.317580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:24.326669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8af1e637-82c7-4908-8e3e-8b7c6da88ba9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.229302 Aug 31 04:37:24.344397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 190/356] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:24 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:24.548515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:24.570081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b775840-b2fa-481d-8940-a36639bc4d48 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.761904 Aug 31 04:37:24.571435 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 167/357] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:23 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:24.586384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:24.587341 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:24.600184 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:24.601564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:24.602203 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:24.603319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:24.603970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:24.604771 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:24.777890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:24.794065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:24.796027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:24.797403 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c574e580-c915-4df3-a6a4-b0b562fd2d44 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.215836 Aug 31 04:37:24.798471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 191/358] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:24 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:24.925824 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:24.926757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:24.946221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:24.949227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:24.950358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:24.952801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:24.953744 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:24.954445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:25.203364 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:25.217018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b128ea44-53e1-4199-8957-a576a1e73dbb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.295031 Aug 31 04:37:25.235862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 168/359] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:24 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:25.351582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:25.352619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:25.361701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:25.362248 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:25.362670 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:25.366480 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:25.367051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:25.367532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:25.592730 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:25.593316 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:25.608496 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:25.609039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:25.609479 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:25.610202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:25.610656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:25.611104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:25.697264 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:25.712481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0f2ad838-765a-4051-b825-57b4ab57c493 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.365744 Aug 31 04:37:25.726755 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 192/360] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:25 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:25.821144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:25.821749 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:25.828754 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:25.834443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:25.835080 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:25.835929 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:25.836463 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:25.837891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:25.931152 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:25.939876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-556bb507-666b-4895-b3db-5eaaefaaa050 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1722 microversion: 2.1 time: 0.350963 Aug 31 04:37:25.945382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 169/361] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:25 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:26.150399 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:26.166007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:26.167788 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:26.169693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2b5f462b-e640-4d5b-8e63-f05a24e652f9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.353154 Aug 31 04:37:26.172288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 193/362] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:25 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:26.248362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:26.249720 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:26.260629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:26.261813 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:26.262495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:26.263506 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:26.264200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:26.264848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:26.500104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:26.509443 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a2f812ca-791b-4eab-8b8a-be724cf82f2e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.272268 Aug 31 04:37:26.524647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 170/363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:26 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:26.737887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:26.739117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:26.747197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:26.748054 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:26.748946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:26.749890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:26.750857 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:26.751499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:26.966828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:26.968206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:26.992912 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:26.995312 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:26.996477 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.002263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.005145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.005979 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.201226 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:27.219251 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fdc26eb8-16d3-4c4e-8786-28f768195748 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1699 microversion: 2.1 time: 0.257089 Aug 31 04:37:27.223648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 171/364] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:26 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1699 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:27.229728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:27.230908 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:27.243654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.244586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.245382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.246845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.247921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.251203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.292767 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:27.314807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c41e8038-fdee-4805-899b-650de2648548 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.580550 Aug 31 04:37:27.315127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 194/365] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:26 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:27.331327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-392d19b4-fda8-4e8b-b51a-fa41ebd08b4d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:27.335512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:27.359609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-392d19b4-fda8-4e8b-b51a-fa41ebd08b4d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.360829 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-392d19b4-fda8-4e8b-b51a-fa41ebd08b4d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.362765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-392d19b4-fda8-4e8b-b51a-fa41ebd08b4d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.490153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-392d19b4-fda8-4e8b-b51a-fa41ebd08b4d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Going to try to start instance {{(pid=127197) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 04:37:27.495159 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:27.503864 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:27.506315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:27.507775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eefa6bb5-e14c-4985-88ac-abb79b498a26 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.282431 Aug 31 04:37:27.508679 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 172/366] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:27 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:27.532913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:27.533830 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:27.548586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.550737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.552327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.554025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.556737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:27.558840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.560500 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.579172 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-392d19b4-fda8-4e8b-b51a-fa41ebd08b4d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action" status: 202 len: 0 microversion: 2.1 time: 0.260873 Aug 31 04:37:27.580687 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 195/367] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:37:27 2022] POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:37:27.598312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:27.607323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:27.628706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.629237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.629781 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.630579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:27.631480 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:27.631901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:27.810181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:27.814416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:27.824473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e5e7f0e8-8f8e-4aff-98e6-5fde05093666 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1371 microversion: 2.1 time: 0.298636 Aug 31 04:37:27.825560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 173/368] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:27 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:27.913029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:27.931847 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-602fcf7b-9227-4d06-8511-7391a63fa9fd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1708 microversion: 2.1 time: 0.346290 Aug 31 04:37:27.934104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 196/369] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:27 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1708 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:28.338039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:28.341090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:28.354437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:28.355224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:28.355806 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:28.356665 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:28.358529 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:28.360301 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:28.535459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:28.535972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:28.550954 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:28.551470 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:28.551873 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:28.571188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:28.574032 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:28.576555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:28.791354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:28.802362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9c438753-076f-47bc-88b0-9a06e9292aa3 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.469979 Aug 31 04:37:28.804212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 174/370] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:28 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:28.847791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:28.848743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:28.862805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:28.869014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:28.879473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:28.880601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:28.881202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:28.881627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.032786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:29.047091 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:29.048328 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:29.049673 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f0474c83-6d9a-4713-a716-8d14a0e1e363 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.518081 Aug 31 04:37:29.056443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 197/371] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:28 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:29.074448 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:29.077311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:29.104790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:29.106008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:29.106818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.107829 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:29.108542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:29.118286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.555842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:29.582376 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6a792877-a485-47d5-8f87-63b4916da1aa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1708 microversion: 2.1 time: 0.519224 Aug 31 04:37:29.585989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 198/372] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:29 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1708 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:29.619233 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-030bcca9-c8b9-46e5-9ba5-d42e6836eb86 req-5fb281af-8a18-48ae-815b-cfefb32a2a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ff7d85-b143-4922-a7a6-e138c68737b8", "name": "network-vif-plugged", "status": "completed", "tag": "d4846db7-f9a0-42ba-82e1-3147a7af8fc3"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:29.636652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:29.649247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c6a4410e-c054-4595-b7fc-0f98b2bc10b1 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1566 microversion: 2.1 time: 0.805614 Aug 31 04:37:29.649981 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 175/373] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:28 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1566 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:29.661500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-030bcca9-c8b9-46e5-9ba5-d42e6836eb86 req-5fb281af-8a18-48ae-815b-cfefb32a2a48 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:29.662550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-030bcca9-c8b9-46e5-9ba5-d42e6836eb86 req-5fb281af-8a18-48ae-815b-cfefb32a2a48 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:29.663233 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-030bcca9-c8b9-46e5-9ba5-d42e6836eb86 req-5fb281af-8a18-48ae-815b-cfefb32a2a48 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.673824 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:29.674566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:29.691374 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:29.699530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:29.699984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.700675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:29.701124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:29.701531 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.712401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-030bcca9-c8b9-46e5-9ba5-d42e6836eb86 req-5fb281af-8a18-48ae-815b-cfefb32a2a48 service nova] Creating event network-vif-plugged:d4846db7-f9a0-42ba-82e1-3147a7af8fc3 for instance a0ff7d85-b143-4922-a7a6-e138c68737b8 on hv-cinder-85530 Aug 31 04:37:29.736798 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-030bcca9-c8b9-46e5-9ba5-d42e6836eb86 req-5fb281af-8a18-48ae-815b-cfefb32a2a48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146212 Aug 31 04:37:29.737840 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 199/374] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:29.842292 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:29.843029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:29.861055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:29.861550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:29.861985 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.862734 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:29.863248 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:29.863660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:29.972471 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1f25dcae-3116-4931-97d2-c148f2d717d2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.302435 Aug 31 04:37:29.975140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 176/375] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:37:29 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-interface => generated 285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:30.092588 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:30.094311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:30.111304 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:30.112031 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:30.112611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:30.113477 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:30.114092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:30.114651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:30.173446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:30.184714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-19d676c4-7670-4e8e-a5f0-81030ae75869 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 0.346799 Aug 31 04:37:30.190930 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 200/376] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:29 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:30.608913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:30.609704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:30.619318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:30.619809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:30.620238 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:30.620935 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:30.632967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:30.633659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:30.649479 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:30.675476 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:30.683862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:30.685745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6826de11-9d69-4f88-ad26-50cfbcb60ee5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.599547 Aug 31 04:37:30.688848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 177/377] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:30 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:31.210707 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:31.212093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:31.223561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:31.225005 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:31.225645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:31.228511 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:31.230431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:31.231202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:31.513702 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:31.524545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-43af730b-6737-4a5e-9a7f-66df3a2f2e3b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1708 microversion: 2.1 time: 0.919463 Aug 31 04:37:31.525730 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 201/378] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:30 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1708 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:31.714408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:31.718397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:31.733279 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:31.738096 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:31.739772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:31.740743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:31.742864 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:31.743977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:32.089138 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:32.101276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:32.111295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:32.113179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f22d1fbe-55d4-4915-9783-c82a32c578af tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.405371 Aug 31 04:37:32.114785 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 202/379] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:31 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:32.444908 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:32.464560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-494bc5c1-a511-4e1f-9fc9-7d6950e6616f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 1.257355 Aug 31 04:37:32.495973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 178/380] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:31 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:32.549148 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:32.549747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:32.562157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:32.562638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:32.567588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:32.568679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:32.571476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:32.572261 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:32.900617 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:32.926000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-808373af-655e-482e-a9d4-df09799ec4fb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1708 microversion: 2.1 time: 0.380548 Aug 31 04:37:32.926601 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 203/381] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:32 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1708 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:33.137984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:33.137984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:33.152549 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:33.152872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:33.153306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:33.165506 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:33.168682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:33.169291 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:33.512257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:33.513238 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:33.574768 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:33.576737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:33.577496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:33.593323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:33.595407 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:33.602652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:33.871355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:33.883418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:33.885303 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:33.889892 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-44a9aab3-39fd-4fee-ba70-8be26a8105a5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.756629 Aug 31 04:37:33.891205 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 179/382] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:33 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:33.900878 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6ae1254f-f57d-47f2-8a2b-6047dffd169c req-cabc0b0b-0643-40f9-83a6-20e7dca05258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543cfc4e-7580-4e55-999c-9bb37cbfca94", "tag": "1f8c2e75-3b33-4b6c-927f-d08d1ef62c56"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:33.923554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6ae1254f-f57d-47f2-8a2b-6047dffd169c req-cabc0b0b-0643-40f9-83a6-20e7dca05258 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:33.924516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6ae1254f-f57d-47f2-8a2b-6047dffd169c req-cabc0b0b-0643-40f9-83a6-20e7dca05258 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:33.925114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6ae1254f-f57d-47f2-8a2b-6047dffd169c req-cabc0b0b-0643-40f9-83a6-20e7dca05258 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:33.976215 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6ae1254f-f57d-47f2-8a2b-6047dffd169c req-cabc0b0b-0643-40f9-83a6-20e7dca05258 service nova] Creating event network-changed:1f8c2e75-3b33-4b6c-927f-d08d1ef62c56 for instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 on hv-cinder-85530 Aug 31 04:37:33.995855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6ae1254f-f57d-47f2-8a2b-6047dffd169c req-cabc0b0b-0643-40f9-83a6-20e7dca05258 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101187 Aug 31 04:37:33.997506 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 180/383] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:34.010008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:34.010222 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:34.037252 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:34.038696 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:34.039335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:34.040375 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:34.041046 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:34.041620 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:34.302354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:34.323378 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-441f6548-b5b8-4197-9773-0cbd7448c854 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1708 microversion: 2.1 time: 0.312440 Aug 31 04:37:34.324147 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 181/384] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:33 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1708 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:34.858324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:34.867977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bc282497-f39b-487d-9ba3-94bf4c9cde39 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1313 microversion: 2.1 time: 1.361521 Aug 31 04:37:34.868564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 204/385] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:33 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1313 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:34.916112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:34.916720 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:34.931345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:34.932989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:34.933451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:34.934166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:34.934618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:34.935064 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:35.198623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:35.218711 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:35.220611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:35.221972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8c04c8ea-e702-4d2a-968d-bdebf8e6ae4a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.310013 Aug 31 04:37:35.222779 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 182/386] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:34 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:35.354338 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:35.356870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:35.369079 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:35.373261 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:35.373694 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:35.376252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:35.379496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:35.382284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:35.822552 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:35.843266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a260c1fb-9fad-448d-976c-8686eb42e53b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1708 microversion: 2.1 time: 0.496947 Aug 31 04:37:35.845026 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 205/387] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:35 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1708 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:35.903782 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:35.906976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:35.914616 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:35.915414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:35.917232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:35.918592 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:35.919222 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:35.921065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:36.248862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:36.252076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:36.269533 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:36.270023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:36.270446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:36.271188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:36.281865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:36.282307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:36.598520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:36.613789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:36.617954 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:36.620451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-add5b800-596b-4423-bb62-a6b8074dea32 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.378629 Aug 31 04:37:36.622840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:36.623903 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 206/388] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:36 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:36.635952 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8d12f8db-e7a4-4531-a098-2cd480e2545d tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1497 microversion: 2.1 time: 0.745681 Aug 31 04:37:36.637216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 183/389] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:35 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1497 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:36.870305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:36.870951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:36.877741 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:36.887913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:36.892450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:36.898007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:36.898925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:36.903403 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:37.176265 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:37.190337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-77ee5330-b3eb-4f75-a64c-45443626a18c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1708 microversion: 2.1 time: 0.325098 Aug 31 04:37:37.193521 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 207/390] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:36 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1708 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:37.646959 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:37.647714 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:37.657420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:37.671103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:37.671762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:37.672632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:37.673198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:37.673708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:37.770368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:37.772677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:37.782479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:37.783369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:37.784093 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:37.785143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:37.786090 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:37.786777 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:37.869646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:37:38.029613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7c70a229-1395-4454-8805-7abf954d48ad tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 204 len: 0 microversion: 2.1 time: 0.266446 Aug 31 04:37:38.030419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 208/391] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:37:37 2022] DELETE /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:37:38.051235 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:38.052988 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:38.075725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:38.076342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:38.076871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:38.077821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:38.078456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:38.079027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:38.180606 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:38.194315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:38.195776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:38.204381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-99b5c262-a4f0-4bf3-aff4-0ebafd378b12 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.561435 Aug 31 04:37:38.210022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 184/392] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:37 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:38.216740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:38.227791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:38.246670 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:38.247186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:38.247591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:38.255904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:38.256558 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:38.256987 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:38.300506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:38.310862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-391fda68-0292-4e23-acd5-24ff81dc1cae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1503 microversion: 2.1 time: 0.274625 Aug 31 04:37:38.312039 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 209/393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:38 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:38.624021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:38.632697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-982c7a2b-66ee-41fb-a2f1-90369c4741b4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1712 microversion: 2.1 time: 0.421181 Aug 31 04:37:38.637680 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 185/394] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:38 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1712 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:39.227700 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:39.228476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:39.240652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:39.242694 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:39.245308 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:39.249990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:39.253182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:39.258984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:39.335082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:39.336261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:39.352417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:39.354825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:39.355458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:39.356445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:39.361625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:39.362370 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:39.585748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:39.596006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:39.600193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:39.608268 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-84ee359d-7c24-46de-9cf8-8ee43dc6a3f7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.385625 Aug 31 04:37:39.608867 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 210/395] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:39 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:39.689173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:39.712440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cb6a6eed-e696-4cfd-986a-b287255f35f2 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1503 microversion: 2.1 time: 0.371701 Aug 31 04:37:39.727800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 186/396] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:39 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:40.637237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:40.638531 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:40.660006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:40.661035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:40.661383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:40.661951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:40.663250 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:40.663918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:40.706815 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:40.743226 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:40.743914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:40.760510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=96 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:40.765977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:40.768295 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:40.768759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:40.769498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:40.769953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:40.770371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:40.912156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:40.923602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:40.925444 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:40.926940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9710a07d-7c8a-4a95-9402-423d3bd31dd2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.294468 Aug 31 04:37:40.942683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 211/397] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:40 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:41.264185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:41.274122 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5916a39f-7b12-42f1-b7fc-53007e97f628 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1503 microversion: 2.1 time: 0.536320 Aug 31 04:37:41.287794 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 187/398] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:40 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:41.752191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-96dd3500-d6f5-4da9-b597-70fccd1f94e5 req-6c95fe48-6208-4585-a530-757c6699b62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ff7d85-b143-4922-a7a6-e138c68737b8", "name": "network-vif-deleted", "tag": "d4846db7-f9a0-42ba-82e1-3147a7af8fc3"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:41.771532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-96dd3500-d6f5-4da9-b597-70fccd1f94e5 req-6c95fe48-6208-4585-a530-757c6699b62f service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:41.772716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-96dd3500-d6f5-4da9-b597-70fccd1f94e5 req-6c95fe48-6208-4585-a530-757c6699b62f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:41.774251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-96dd3500-d6f5-4da9-b597-70fccd1f94e5 req-6c95fe48-6208-4585-a530-757c6699b62f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:41.827678 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-96dd3500-d6f5-4da9-b597-70fccd1f94e5 req-6c95fe48-6208-4585-a530-757c6699b62f service nova] Creating event network-vif-deleted:d4846db7-f9a0-42ba-82e1-3147a7af8fc3 for instance a0ff7d85-b143-4922-a7a6-e138c68737b8 on hv-cinder-85530 Aug 31 04:37:41.844164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-96dd3500-d6f5-4da9-b597-70fccd1f94e5 req-6c95fe48-6208-4585-a530-757c6699b62f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095537 Aug 31 04:37:41.848514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 212/399] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:41.954613 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:41.955500 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:41.975530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:41.977327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:41.977773 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:41.978487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:41.978972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:41.979559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:42.254618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:42.267682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:42.269191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:42.270392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-16bdefac-5866-4c68-b9fe-cdaecf7c28e0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1739 microversion: 2.20 time: 0.323431 Aug 31 04:37:42.278113 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 188/400] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:41 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:42.298707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:42.300327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:42.320523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:42.329607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:42.332128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:42.335783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:42.336461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:42.341335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:42.436092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:42.436959 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:42.437878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:42.438698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lazy-loading 'fault' on Instance uuid a0ff7d85-b143-4922-a7a6-e138c68737b8 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:37:42.504154 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:42.517344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a9888872-c6d6-4db6-a8ef-939009220e34 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1303 microversion: 2.1 time: 0.224597 Aug 31 04:37:42.517934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 213/401] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:42 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:43.296633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:43.297383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:43.313685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:43.314175 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:43.314615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:43.315379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:43.315828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:43.316244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:43.510860 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7c09a01-7c6f-4267-a25b-33d2b7d1f3ec", "device": "/dev/sdb"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:43.515190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:43.521332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:43.522503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:43.522989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:43.523746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:43.524190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:43.524796 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:43.648820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:43.657132 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:43.658587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:43.663951 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2c92268c-a40c-4b27-ad18-15577fbcda0a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1721 microversion: 2.20 time: 0.369336 Aug 31 04:37:43.671749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 189/402] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:43 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:43.682790 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:43.683425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:43.694225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:43.697025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:43.697464 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:43.698188 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:43.698638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:43.699077 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:43.827268 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:43.828413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:43.829433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:43.830528 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lazy-loading 'fault' on Instance uuid a0ff7d85-b143-4922-a7a6-e138c68737b8 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:37:43.911764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:43.933636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ffa8e3a7-d70e-4a06-b4a5-c27ed08042b0 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 200 len: 1303 microversion: 2.1 time: 0.260496 Aug 31 04:37:43.943025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 190/403] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:43 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 1303 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:44.179294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2d674fdf-acf6-49ca-8484-fbe326de1948 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "POST /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673019 Aug 31 04:37:44.187562 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 214/404] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:37:43 2022] POST /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:44.689563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:44.690437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:44.702584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:44.703097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:44.703527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:44.704225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:44.704660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:44.707371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:44.710488 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:44.930200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:44.942892 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:44.945307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:44.946759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-552b4471-d971-4156-b1f0-46c68633ebb2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1721 microversion: 2.20 time: 0.260941 Aug 31 04:37:44.947824 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 191/405] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:44 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:44.955897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:44.956699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: a0ff7d85-b143-4922-a7a6-e138c68737b8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:44.969283 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:44.969773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:44.971256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:44.972155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:44.972634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:44.973053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:44.994534 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] HTTP exception thrown: Instance a0ff7d85-b143-4922-a7a6-e138c68737b8 could not be found. Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Request method failure captured: Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 HTTP/1.1 Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuV1c1vXYu930sPOJ8K4ZrlAeSqBbiBVQ2T0ibjJs-cl2gH9bzXj-r1C4ZLjtIOCB82zNdfJqMQLiNAEoo8ctT_4xGcxzmyuGXW7kQ2Wqp7AFtol-3feZMb34spFxvugrH8_Q-5nYSE-aht1KvG-gzLB0od6jh2LRphTgXQBTAUP3TY Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: b35a44f3c0ba4230bac2bcb9d4e8ec08 Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-VolumesActionsTest-1011385237 Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:37:44.997027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35a44f3c0ba4230bac2bcb9d4e8ec08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b35a44f3c0ba4230bac2bcb9d4e8ec08", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b35a44f3c0ba4230bac2bcb9d4e8ec08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35a44f3c0ba4230bac2bcb9d4e8ec08"}]}] Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-VolumesActionsTest-1011385237 Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: b35a44f3c0ba4230bac2bcb9d4e8ec08 Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-VolumesActionsTest-1011385237 Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-VolumesActionsTest-1011385237-project Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: fffc906c79ba418cbc52e5db5ca991ca Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-VolumesActionsTest-1011385237-project Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance a0ff7d85-b143-4922-a7a6-e138c68737b8 could not be found. Aug 31 04:37:44.998618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': 'a0ff7d85-b143-4922-a7a6-e138c68737b8'} Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ff7d85-b143-4922-a7a6-e138c68737b8 could not be found. Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:37:44.999641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ff7d85-b143-4922-a7a6-e138c68737b8 could not be found. Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ff7d85-b143-4922-a7a6-e138c68737b8 could not be found. Aug 31 04:37:45.001104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:37:45.003728 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Returning 404 to user: Instance a0ff7d85-b143-4922-a7a6-e138c68737b8 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:37:45.005035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-43b90caa-56f6-452c-92db-2952344cb351 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8" status: 404 len: 111 microversion: 2.1 time: 0.054040 Aug 31 04:37:45.005762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 215/406] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:44 2022] GET /compute/v2.1/servers/a0ff7d85-b143-4922-a7a6-e138c68737b8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:37:45.183077 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1666080177", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "networks": [{"uuid": "aa427dea-fb3a-4e27-9187-8436fa27cc39"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:45.262128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] validate_networks() for [('aa427dea-fb3a-4e27-9187-8436fa27cc39', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:37:45.739852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:37:45.743208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:37:45.743867 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:37:45.744428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:37:45.744985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:37:45.766303 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:45.766840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:45.767278 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:45.768010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:45.768475 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:45.768917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:45.794587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Getting quotas for project b35a44f3c0ba4230bac2bcb9d4e8ec08. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:37:45.799685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Getting quotas for user fffc906c79ba418cbc52e5db5ca991ca and project b35a44f3c0ba4230bac2bcb9d4e8ec08. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:37:45.824280 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:37:45.829716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:37:45.915200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-36dd2f5c-970d-46f0-b720-af401f422ddd tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732395 Aug 31 04:37:45.916029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 192/407] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:37:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:37:45.926924 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-315d641e-43fa-4ff3-a7a5-c3b3a05d47ea tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:45.927613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-315d641e-43fa-4ff3-a7a5-c3b3a05d47ea tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:45.980718 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:45.981708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:45.988599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:45.989455 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:45.990089 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:45.991083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:45.991734 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:45.992346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:45.992729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-315d641e-43fa-4ff3-a7a5-c3b3a05d47ea tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:46.001170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-315d641e-43fa-4ff3-a7a5-c3b3a05d47ea tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1214 microversion: 2.1 time: 0.078201 Aug 31 04:37:46.001743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 216/408] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:45 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:46.224154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:46.235537 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:46.243979 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:46.245238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-030f3473-75ea-441a-b6d3-dcc13e6c3956 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1721 microversion: 2.20 time: 0.268498 Aug 31 04:37:46.255360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 193/409] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:45 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:47.026735 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:47.028153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:47.035658 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:47.040710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:47.041157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:47.041923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:47.042362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:47.042826 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:47.125092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:47.136834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4f0cdc04-47ba-4da5-a8a3-5ce119480d29 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1210 microversion: 2.1 time: 0.114858 Aug 31 04:37:47.141350 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 217/410] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:47 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:47.223793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6496ccdc-1807-4308-9bdd-a55200377d6f req-f2dc1f06-40bc-4a44-8fe2-fd351a47dfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ba9256-6be0-49de-8c61-4454227a18c8", "name": "network-vif-unplugged", "status": "completed", "tag": "f3809b0b-8437-4e98-88a3-a530ac0d92f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:47.242346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6496ccdc-1807-4308-9bdd-a55200377d6f req-f2dc1f06-40bc-4a44-8fe2-fd351a47dfab service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:47.258287 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6496ccdc-1807-4308-9bdd-a55200377d6f req-f2dc1f06-40bc-4a44-8fe2-fd351a47dfab service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:47.259267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6496ccdc-1807-4308-9bdd-a55200377d6f req-f2dc1f06-40bc-4a44-8fe2-fd351a47dfab service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:47.272031 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:47.273015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:47.280533 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6496ccdc-1807-4308-9bdd-a55200377d6f req-f2dc1f06-40bc-4a44-8fe2-fd351a47dfab service nova] Creating event network-vif-unplugged:f3809b0b-8437-4e98-88a3-a530ac0d92f8 for instance 16ba9256-6be0-49de-8c61-4454227a18c8 on hv-cinder-85530 Aug 31 04:37:47.282622 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:47.285294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:47.287958 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:47.289055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6496ccdc-1807-4308-9bdd-a55200377d6f req-f2dc1f06-40bc-4a44-8fe2-fd351a47dfab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068359 Aug 31 04:37:47.290014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 194/411] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:37:47.294128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:47.294877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:47.295595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:47.448692 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:47.458015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:47.459830 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:47.461659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4baba2f1-d4ab-4041-87e8-7c67b37cf2ea tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1724 microversion: 2.20 time: 0.196224 Aug 31 04:37:47.462219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 218/412] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:47 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:47.488140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b9186ae-95bb-4563-a415-ca6969168669"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:47.494229 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:47.500685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:47.501346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:47.501952 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:47.503007 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:47.503454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:47.503869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:47.874234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bb384a55-3b69-4cb3-928c-c6e1e3fbe018 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.391065 Aug 31 04:37:47.875053 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 195/413] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Aug 31 04:37:47 2022] POST /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments => generated 188 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:37:48.009403 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:48.010256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:48.016872 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:48.017644 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:48.018295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:48.019261 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:48.019921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:48.020543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:48.073124 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127197) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 04:37:48.159436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:48.160230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:48.174554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:48.175135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:48.175631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:48.176515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:48.177122 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:48.177383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7e2a420a-2601-4ddc-9864-24be699f2738 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/action" status: 202 len: 0 microversion: 2.20 time: 0.172100 Aug 31 04:37:48.177856 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:48.181960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 219/414] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 04:37:48 2022] POST /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:37:48.188548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:48.189344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:48.197740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:48.198397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:48.198839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:48.199588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:48.200199 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:48.200610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:48.305775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:48.318066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-55d9dffe-370f-4208-a7e5-4d428dcf2cac tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1266 microversion: 2.1 time: 0.162317 Aug 31 04:37:48.327460 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 196/415] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:48 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:48.377066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:48.387157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:48.388931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:48.390379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5be66059-a1a9-4af9-a32c-7b9d929a97f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1810 microversion: 2.20 time: 0.206872 Aug 31 04:37:48.406065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 220/416] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:48 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:49.341457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:49.342730 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:49.353331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:49.354369 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:49.355269 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:49.356590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:49.357411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:49.368712 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:49.416575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:49.417177 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:49.425152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:49.429866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:49.431382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:49.435945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:49.436580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:49.437173 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:49.440676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:49.452723 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e349c116-6eb1-4216-ae92-b3f0d3489f38 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1266 microversion: 2.1 time: 0.114541 Aug 31 04:37:49.453758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 197/417] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:49 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:49.599492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:49.609194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:49.610594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:49.612564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5e984761-6e38-4294-89c1-847bf0e1ffb0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1810 microversion: 2.20 time: 0.202913 Aug 31 04:37:49.613133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 221/418] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:49 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:50.475391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:50.476889 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:50.484331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:50.485055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:50.485480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:50.486335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:50.487032 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:50.487603 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:50.560663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:50.571510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ee9dbe20-dde9-4950-b39d-5c2eaf819ab8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1266 microversion: 2.1 time: 0.101563 Aug 31 04:37:50.588336 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 198/419] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:50 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:50.639907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:50.648964 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:50.680072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:50.683495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:50.685790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:50.688939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:50.690704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:50.691654 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:50.901837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:50.910699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:50.912189 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:50.913718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9c4dfb02-fe55-4c14-8e3d-9c7460c95286 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1810 microversion: 2.20 time: 0.281925 Aug 31 04:37:50.914279 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 222/420] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:50 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:51.591899 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:51.593952 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:51.604735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:51.605473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:51.605622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:51.606628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:51.607109 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:51.607520 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:51.779990 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:51.790564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-678bc7e4-060c-42e2-911a-a0010d7bb23f tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1272 microversion: 2.1 time: 0.202536 Aug 31 04:37:51.804253 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 199/421] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:51 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:51.943332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:51.944699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:51.967973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:51.968912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:51.969414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:51.970521 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:51.971508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:51.975159 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:52.221630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:52.234876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:52.238104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:52.241674 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ae015d74-c6a4-4083-9710-79ea2f92d12b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1752 microversion: 2.20 time: 0.303806 Aug 31 04:37:52.244450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 223/422] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:51 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1752 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:52.496521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5d86d26c-4176-4093-8d9f-64ade5fbc799 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Action: 'create', calling method: .version_select at 0x7fc827442550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-592710292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLre95LI6DSsTGT7ztE4FkynRZSNJ5yEksy0AGnwnTnZkTYW2Ur0a1r3PWCTpKJIYbxGJuqIvx1UKIs1yyuN+TevdXYkNEtQ3/wW262AuA2e/xDDECJKaXC+Rwb2qTWhcw=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:52.511835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-5d86d26c-4176-4093-8d9f-64ade5fbc799 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Getting quotas for project 6714373199f5419a9a70267187067934. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:37:52.515768 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-5d86d26c-4176-4093-8d9f-64ade5fbc799 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Getting quotas for user 6b1139bf460a49d2b0156912be60fa36 and project 6714373199f5419a9a70267187067934. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:37:52.540461 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5d86d26c-4176-4093-8d9f-64ade5fbc799 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047764 Aug 31 04:37:52.541276 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 200/423] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:37:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:52.649838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1421660584", "imageRef": "4c8ec20b-4699-4218-a9ba-fba8fbf250cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-592710292", "networks": [{"uuid": "e8667517-3360-4053-ba73-ab7205fbbabb"}]}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:52.703320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] validate_networks() for [('e8667517-3360-4053-ba73-ab7205fbbabb', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:37:52.812448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:52.813080 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:52.820065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:52.820875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:52.821328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:52.822489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:52.822489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:52.822863 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:53.044180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:53.052544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5845e1d2-1dfa-4d2d-87c4-5414ffa894db tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.244029 Aug 31 04:37:53.066357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 201/424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:52 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:53.140145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:37:53.140581 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:37:53.141151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:37:53.141595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:37:53.142083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:37:53.151767 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:53.152325 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:53.152820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:53.153631 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:53.154156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:53.154572 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:53.172570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Getting quotas for project 6714373199f5419a9a70267187067934. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:37:53.176707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Getting quotas for user 6b1139bf460a49d2b0156912be60fa36 and project 6714373199f5419a9a70267187067934. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:37:53.188397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:37:53.190624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c8ec20b-4699-4218-a9ba-fba8fbf250cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:37:53.241255 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-88377174-a126-4f03-bf78-48cad3b8d493 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595377 Aug 31 04:37:53.242517 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 224/425] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:37:53.252987 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2fd706b3-fa7b-459d-aae8-909086fbe1d4 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:53.253743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2fd706b3-fa7b-459d-aae8-909086fbe1d4 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:53.270474 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:53.272215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:53.282474 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:53.283447 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:53.283948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:53.284748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:53.285193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:53.285804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:53.377679 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2fd706b3-fa7b-459d-aae8-909086fbe1d4 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:53.403094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2fd706b3-fa7b-459d-aae8-909086fbe1d4 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1258 microversion: 2.1 time: 0.153836 Aug 31 04:37:53.406295 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 202/426] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:53 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:53.466918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:53.478701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:53.486330 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:53.490565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-63bc56e3-88a6-459e-be49-01e655c16715 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1752 microversion: 2.20 time: 0.227522 Aug 31 04:37:53.491257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 225/427] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:53 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:53.698993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-e3ec947b-88c0-4e29-bef8-2045b2fb334e req-8b0d2ae5-e4a7-4506-933a-87100a94d880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ccbc34-3498-4aef-b361-e9b51a07e9d2", "tag": "6cecccca-7742-4933-8fe3-16ec55261d1a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:37:53.719118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e3ec947b-88c0-4e29-bef8-2045b2fb334e req-8b0d2ae5-e4a7-4506-933a-87100a94d880 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:53.719948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e3ec947b-88c0-4e29-bef8-2045b2fb334e req-8b0d2ae5-e4a7-4506-933a-87100a94d880 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:53.720571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e3ec947b-88c0-4e29-bef8-2045b2fb334e req-8b0d2ae5-e4a7-4506-933a-87100a94d880 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:53.733360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-e3ec947b-88c0-4e29-bef8-2045b2fb334e req-8b0d2ae5-e4a7-4506-933a-87100a94d880 service nova] Creating event network-changed:6cecccca-7742-4933-8fe3-16ec55261d1a for instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 on hv-cinder-85530 Aug 31 04:37:53.741074 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-e3ec947b-88c0-4e29-bef8-2045b2fb334e req-8b0d2ae5-e4a7-4506-933a-87100a94d880 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051240 Aug 31 04:37:53.742680 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 203/428] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:37:54.075146 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:54.076552 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:54.090550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:54.091305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:54.091751 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:54.094055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:54.094681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:54.095276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:54.296440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:54.312140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ec0606ea-6087-4832-8c49-aa8f88333ce6 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.241770 Aug 31 04:37:54.313052 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 226/429] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:54 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:54.425216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:54.425873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:54.432432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:54.433078 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:54.433492 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:54.434166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:54.434605 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:54.435029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:54.515538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:54.516940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:54.525469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:54.526674 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:54.527358 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:54.528402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:54.529051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:54.529672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:54.544512 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:54.557126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ddf834b9-8f23-4b80-bdb5-d3fac667b3cd tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1254 microversion: 2.1 time: 0.136322 Aug 31 04:37:54.557989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 204/430] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:54 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1254 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:54.745007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:54.753962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:54.755452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:54.756612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ad5f4cd3-da90-4648-8e50-cd384de9b0ec tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1752 microversion: 2.20 time: 0.245570 Aug 31 04:37:54.757214 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 227/431] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:54 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:55.336577 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:55.337178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:55.343442 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:55.343911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:55.344337 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:55.345013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:55.345452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:55.345858 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:55.485022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:55.492933 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a1d7a0d4-ec59-4326-a8b0-9fa05fc880d9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.162215 Aug 31 04:37:55.493515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 205/432] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:55 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:55.583978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:55.584780 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:55.591910 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:55.592383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:55.592809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:55.593477 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:55.593920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:55.594331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:55.609601 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:55.658331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:55.666314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6ac7bcd3-6c16-4332-9598-6206decfe90c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1310 microversion: 2.1 time: 0.088991 Aug 31 04:37:55.666913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 228/433] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:55 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:55.779874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:55.780664 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:55.782626 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:55.788101 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:55.788576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:55.788991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:55.789701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:55.790115 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:55.790520 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:55.929206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:55.938428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:55.939902 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:55.941090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6d92c98c-1104-4b4b-b37c-31143a6cd16d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1752 microversion: 2.20 time: 0.165122 Aug 31 04:37:55.941642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 206/434] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:55 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:37:56.514301 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:56.514822 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:56.517844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:56.521299 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:56.521766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:56.522193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:56.523144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:56.523638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:56.524058 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:56.660684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:56.669183 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-107a4514-13b8-4feb-80e2-4f5e68eca1ed tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.158914 Aug 31 04:37:56.669743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 229/435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:56 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:56.688497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:56.689110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:56.697800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:56.698248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:56.698804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:56.699521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:56.699961 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:56.700370 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:56.771846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:56.782980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5fa4c45d-ee3d-40ae-bfa7-0727faa89528 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1310 microversion: 2.1 time: 0.099095 Aug 31 04:37:56.783681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 207/436] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:56 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:56.968608 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:56.969594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:56.980090 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:56.980870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:56.981597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:56.982682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:56.983449 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:56.984140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:57.141301 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:57.150943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:57.152372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:57.153531 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-48e1be3b-56f5-408a-a4d7-8cbeb999d95c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1752 microversion: 2.20 time: 0.191479 Aug 31 04:37:57.154065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 230/437] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:56 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1752 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:57.689805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:57.690371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:57.697011 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:57.697484 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:57.697903 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:57.698577 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:57.699047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:57.699458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:57.805439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:57.806285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:57.813163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:57.813609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:57.814209 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:57.814938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:57.815380 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:57.815799 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:57.831195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:57.839271 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b15c2f7-0bb9-4e42-96b0-b0de8df8e1f8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.153497 Aug 31 04:37:57.839827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 208/438] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:57 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:57.878026 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:57.885998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-299ca210-dab9-48e5-98c7-80b2ec626882 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1310 microversion: 2.1 time: 0.084509 Aug 31 04:37:57.886581 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 231/439] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:57 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:58.177309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:58.178009 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:58.185434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:58.185984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:58.186473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:58.187302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:58.187849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:58.188299 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:58.191272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:58.324335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:58.333449 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:58.334862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:58.336016 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-83f40b47-1b1a-4186-a7bb-1f1f57197367 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1752 microversion: 2.20 time: 0.163368 Aug 31 04:37:58.336562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 209/440] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:58 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:37:58.860793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:58.861501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:58.868151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:58.870396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:58.870802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:58.871496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:58.871925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:58.872356 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:58.907607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:58.908909 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:58.916440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:58.917272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:58.917896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:58.919046 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:58.919715 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:58.920326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:58.983808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:58.991586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-98bd4ddb-6c4d-4881-84fc-01ce48b6b70a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1310 microversion: 2.1 time: 0.088530 Aug 31 04:37:58.992146 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 210/441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:58 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:37:59.015894 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:59.023756 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0f459a2d-6ac3-4681-9f65-63cad7c86528 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.166788 Aug 31 04:37:59.024623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 232/442] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:37:58 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:37:59.364218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:37:59.365219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:37:59.373003 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:59.373485 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:59.373911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:59.374917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:37:59.375008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:37:59.375431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:37:59.766955 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:59.776324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:59.777760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:37:59.778962 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1b5d3be0-7b42-4ae4-a6cc-6c6040ff80cd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.421311 Aug 31 04:37:59.779523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 211/443] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:37:59 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:00.016710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:00.017567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:00.027324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:00.027808 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:00.028239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:00.028932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:00.029380 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:00.029798 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:00.045086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:00.045691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:00.052223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:00.052701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:00.053130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:00.053816 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:00.054262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:00.054674 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:00.096726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:00.105069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e8671c1c-78a1-4051-a81f-6d75b4e796bb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1310 microversion: 2.1 time: 0.095233 Aug 31 04:38:00.105639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 233/444] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:00 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:00.189830 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:00.200490 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-963b499a-e0c5-4141-8c42-e6571d83d576 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.159254 Aug 31 04:38:00.201033 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 212/445] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:00 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:00.805084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:00.806072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:00.813361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:00.813837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:00.814260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:00.814983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:00.815422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:00.815837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:00.951509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:00.960145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:00.961550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:00.962699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cd17d437-b572-4d9b-beba-5cd1c76668b6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.164223 Aug 31 04:38:00.963413 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 234/446] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:00 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:01.126410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:01.127014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:01.133937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:01.134410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:01.134874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:01.135622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:01.136065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:01.136477 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:01.198494 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:01.210198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8d9fcad4-7f42-4f0a-970c-231d77a12dcf tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1310 microversion: 2.1 time: 0.087446 Aug 31 04:38:01.210837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 213/447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:01 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:01.221363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:01.221963 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:01.231099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:01.231561 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:01.231983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:01.232661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:01.233099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:01.233506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:01.378380 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:01.386504 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fcc5dd53-3e25-44a1-a4c6-290ef44817ae tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.168981 Aug 31 04:38:01.387111 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 235/448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:01 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:01.986054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:01.986681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:01.993177 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:01.993653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:01.994073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:01.994820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:01.995266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:01.995781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:02.127433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:02.136620 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:02.138002 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:02.139185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6d7b2e23-3d2f-45d6-95c7-8c9a3be55a64 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.157113 Aug 31 04:38:02.139711 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 214/449] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:01 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:02.232052 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:02.232659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:02.239115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:02.239598 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:02.240024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:02.240924 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:02.241402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:02.241941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:02.303027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:02.311263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-416a7cc9-b4e4-4354-be2c-23b51bdc5c3c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1310 microversion: 2.1 time: 0.083581 Aug 31 04:38:02.311819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 236/450] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:02 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:02.411267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:02.412257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:02.420940 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:02.421607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:02.422035 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:02.422804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:02.423234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:02.423676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:02.556036 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:02.566236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e215cfb5-ebe3-443e-8257-146d69cfd669 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.161424 Aug 31 04:38:02.566947 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 215/451] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:02 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:03.163838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:03.164406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:03.166572 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:03.172748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:03.173353 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:03.173856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:03.174643 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:03.175205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:03.175705 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:03.185164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=8 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:03.333724 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:03.335061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:03.344942 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:03.354623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:03.355356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:03.356355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:03.356800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:03.357399 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:03.368561 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:03.382331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=12 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:03.392773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:03.397408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:03.399058 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-09682f63-6450-498c-ad68-a5ee38efa722 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.240027 Aug 31 04:38:03.401114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 237/452] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:03 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:03.507458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:03.514603 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e80f237b-f287-4d91-8160-e619fdcd3d7c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1316 microversion: 2.1 time: 0.186544 Aug 31 04:38:03.515661 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 216/453] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:03 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:03.589368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:03.590280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:03.600672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:03.603079 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:03.603706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:03.605259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:03.606500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:03.608298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:03.892444 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:03.908410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8a6630f0-42e0-488d-b460-5b5aeed5de36 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.323584 Aug 31 04:38:03.909205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 238/454] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:03 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:04.424665 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:04.425304 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:04.432363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:04.432859 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:04.433328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:04.434119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:04.434497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:04.435127 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:04.535804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:04.537273 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:04.544375 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:04.545229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:04.545855 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:04.546955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:04.547632 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:04.548245 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:04.576646 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:04.585653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:04.588366 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:04.590504 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3335a75a-505b-4c64-9027-b558ec1d0d07 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.169591 Aug 31 04:38:04.591517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 217/455] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:04 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:04.700185 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:04.712095 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-900984d1-c927-4841-b2a1-1908b62da5f1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.180158 Aug 31 04:38:04.713070 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 239/456] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:04 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:04.933939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:04.934655 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:04.941269 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:04.941772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:04.942192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:04.942923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:04.943366 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:04.943756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:05.115877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:05.125094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-efd8d873-309b-435a-a730-c3d206616b1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.195013 Aug 31 04:38:05.132772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 218/457] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:04 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:05.614400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:05.615765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:05.623069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:05.624191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:05.624866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:05.625779 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:05.626453 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:05.627110 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:05.740034 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:05.740801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:05.748043 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:05.748519 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:05.748943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:05.749633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:05.750070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:05.750477 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:05.773183 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:05.785627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:05.787384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:05.788728 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7ec47f88-6bcb-41b5-b8b9-57a310a41946 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.178573 Aug 31 04:38:05.789749 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 240/458] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:05 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:05.907056 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:05.914993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-31bb7b1d-33b5-4460-9060-43bada955f68 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.179782 Aug 31 04:38:05.915566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 219/459] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:05 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:06.145721 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:06.146320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:06.153610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:06.154028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:06.154457 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:06.155184 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:06.155623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:06.156033 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:06.228221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-fc05df54-b76e-4c71-bbc6-f8a21acbc18a req-fe11729b-3e91-4b6e-93c1-8592f8a2d4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ccbc34-3498-4aef-b361-e9b51a07e9d2", "name": "network-vif-plugged", "status": "completed", "tag": "6cecccca-7742-4933-8fe3-16ec55261d1a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:06.248197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fc05df54-b76e-4c71-bbc6-f8a21acbc18a req-fe11729b-3e91-4b6e-93c1-8592f8a2d4c6 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:06.248675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fc05df54-b76e-4c71-bbc6-f8a21acbc18a req-fe11729b-3e91-4b6e-93c1-8592f8a2d4c6 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:06.249099 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fc05df54-b76e-4c71-bbc6-f8a21acbc18a req-fe11729b-3e91-4b6e-93c1-8592f8a2d4c6 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:06.278844 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-fc05df54-b76e-4c71-bbc6-f8a21acbc18a req-fe11729b-3e91-4b6e-93c1-8592f8a2d4c6 service nova] Creating event network-vif-plugged:6cecccca-7742-4933-8fe3-16ec55261d1a for instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 on hv-cinder-85530 Aug 31 04:38:06.285257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-fc05df54-b76e-4c71-bbc6-f8a21acbc18a req-fe11729b-3e91-4b6e-93c1-8592f8a2d4c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061808 Aug 31 04:38:06.288661 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 220/460] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:06.343028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:06.351669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-dede91aa-bbc3-4229-9ca8-a2abf9c99a1a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.210008 Aug 31 04:38:06.352256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 241/461] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:06 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:06.812958 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:06.813622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:06.820546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:06.821302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:06.821723 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:06.822708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:06.823184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:06.823600 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:06.938035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:06.939469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:06.946436 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:06.947303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:06.947937 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:06.948782 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:06.949623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:06.950187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:06.966230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:06.976797 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:06.978242 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:06.979733 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e2e3ce1a-dfd5-46f4-be04-8f93510d63e6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.171744 Aug 31 04:38:06.980900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 221/462] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:06 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:07.127441 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:07.136374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0f4a8170-4cf2-4c81-9c9a-a217c3a12bb5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.202401 Aug 31 04:38:07.137118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 242/463] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:06 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:07.376398 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:07.377354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:07.384565 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:07.385214 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:07.385715 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:07.386566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:07.387593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:07.388043 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:07.532324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:07.540327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7ba00468-a74f-419b-bb92-87eee07a5515 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.169246 Aug 31 04:38:07.540907 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 222/464] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:07 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:08.008590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:08.009301 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:08.016328 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:08.016802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:08.017258 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:08.017947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:08.018389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:08.018807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:08.158198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:08.158929 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:08.161446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:08.169532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:08.172947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:08.173562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:08.174008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:08.174794 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:08.175276 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:08.175660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:08.182372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:08.183994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:08.185247 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3eba216f-d594-4295-ad7d-12fcecae29a3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.181188 Aug 31 04:38:08.198686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 243/465] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:08 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:08.319362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:08.332437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d2a74ae-e5d2-4351-b813-af8021c6b858 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.178103 Aug 31 04:38:08.342984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 223/466] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:08 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:08.563520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:08.564563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:08.571323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:08.571791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:08.572211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:08.572888 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:08.573324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:08.573729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:08.714434 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:08.723960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-da033b89-b280-4727-bfbd-2aec51d70295 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.165195 Aug 31 04:38:08.732535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 244/467] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:08 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:09.208574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:09.209209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:09.216790 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:09.217275 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:09.217740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:09.218447 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:09.218933 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:09.219333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:09.353878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:09.354478 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:09.370808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:09.374967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:09.375951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:09.382121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:09.385859 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:09.386817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:09.387570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:09.388097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:09.392487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:09.393808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2c41308f-41a7-4183-98ac-536c456bd0e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.189250 Aug 31 04:38:09.397403 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 224/468] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:09 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:09.397579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:09.539977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:09.548152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9c49d031-59d7-480e-8e6b-a2d6aa2f3e71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.198427 Aug 31 04:38:09.548797 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 245/469] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:09 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:09.745725 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:09.746403 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:09.752611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:09.753092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:09.753570 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:09.754272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:09.754749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:09.755161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:09.890609 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:09.899582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fbb8ce43-ff7f-4abe-8382-b5033e4df909 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.157575 Aug 31 04:38:09.900350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 225/470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:09 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:10.417507 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:10.418187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:10.425694 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.426180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.426613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:10.427349 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.427800 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.428215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:10.526216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:10.527391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:10.534441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.534978 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.535582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:10.536448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.536901 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.537318 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:10.567482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:10.577845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:10.579827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:10.588064 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cd982e44-c6ed-42c4-a81f-d2bc05c8eacd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.174589 Aug 31 04:38:10.597035 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:10.603482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 246/471] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:10 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:38:10.613951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:10.615060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:10.623461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.624545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.625234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:10.626170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.626896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.627554 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:10.685218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lazy-loading 'services' on Instance uuid 4bafbd2f-51ff-419e-995e-c8455ecd93a7 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:38:10.794928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:10.804684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-818a551a-12db-4a49-a7a8-b7512a59222f tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.196979 Aug 31 04:38:10.806275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 247/472] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:10 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:10.821536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c215e871-4310-4c00-a9ea-c19ef6dc6313 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7/os-volume_attachments/c7c09a01-7c6f-4267-a25b-33d2b7d1f3ec" status: 202 len: 0 microversion: 2.1 time: 0.299895 Aug 31 04:38:10.822175 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 226/473] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:38:10 2022] DELETE /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7/os-volume_attachments/c7c09a01-7c6f-4267-a25b-33d2b7d1f3ec => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:38:10.919790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:10.920398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:10.926521 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.926973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.927391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:10.928080 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:10.928549 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:10.928991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:11.072696 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:11.080767 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-308e0549-0830-45cc-ac53-5a4b9821c1c8 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.165115 Aug 31 04:38:11.081331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 248/474] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:10 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:11.619990 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:11.620685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:11.628659 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:11.629338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:11.629771 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:11.630569 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:11.631239 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:11.631699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:11.783632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:11.792498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:11.795521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:11.797620 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e3c65a69-39a8-4a31-af3b-9b0610141a59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.182352 Aug 31 04:38:11.798595 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 227/475] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:11 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:11.827047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:11.827689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:11.835127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:11.835604 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:11.836032 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:11.836852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:11.837294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:11.837703 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:11.974068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:11.982699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-973f82e2-0263-4b3f-8ed7-095397da2cc3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.159834 Aug 31 04:38:11.983286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 249/476] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:11 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:12.102110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:12.102758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:12.109234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:12.109708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:12.110129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:12.110841 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:12.111275 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:12.111689 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:12.337972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:12.346599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ef637be2-1242-4a0c-835f-919bd31d3aa5 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.248693 Aug 31 04:38:12.347221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 228/477] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:12 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:12.827228 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:12.827849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:12.834259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:12.834760 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:12.835189 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:12.835882 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:12.836320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:12.836730 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:12.971512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:12.995671 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:13.008545 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:13.009258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:13.019550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:13.020396 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:13.021143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a5095269-71fe-497b-9315-3b8fb74d1660 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.198194 Aug 31 04:38:13.021807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 250/478] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:12 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:13.022415 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:13.023225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:13.024473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:13.025134 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:13.025872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:13.176102 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-b592a01a-55bb-4865-930a-9abd6c0b5021 req-e0177374-b548-41a7-a68d-a48e5ab03dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72bff5a-e67f-4494-bdea-4971a277e537", "tag": "f13a5355-33c4-4ae4-aaed-4afc34e93d15"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:13.185558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-b592a01a-55bb-4865-930a-9abd6c0b5021 req-e0177374-b548-41a7-a68d-a48e5ab03dad service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:13.186116 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-b592a01a-55bb-4865-930a-9abd6c0b5021 req-e0177374-b548-41a7-a68d-a48e5ab03dad service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:13.186483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-b592a01a-55bb-4865-930a-9abd6c0b5021 req-e0177374-b548-41a7-a68d-a48e5ab03dad service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:13.197440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-b592a01a-55bb-4865-930a-9abd6c0b5021 req-e0177374-b548-41a7-a68d-a48e5ab03dad service nova] Creating event network-changed:f13a5355-33c4-4ae4-aaed-4afc34e93d15 for instance c72bff5a-e67f-4494-bdea-4971a277e537 on hv-cinder-85530 Aug 31 04:38:13.202885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-b592a01a-55bb-4865-930a-9abd6c0b5021 req-e0177374-b548-41a7-a68d-a48e5ab03dad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030455 Aug 31 04:38:13.203519 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 251/479] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:38:13.300621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:13.308459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-170534f7-127e-4beb-ada9-0d8f987459b1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.304258 Aug 31 04:38:13.309018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 229/480] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:13 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:13.368714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:13.369412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:13.376149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:13.376622 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:13.377082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:13.377773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:13.378214 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:13.378633 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:13.518621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:13.526648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-da29b652-01b0-460f-9a4a-66c9f6613203 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.162186 Aug 31 04:38:13.527231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 252/481] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:13 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:14.049763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:14.052747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:14.061647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.062464 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.063064 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.063951 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.064628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.065033 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.110020 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:14.110553 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:14.117170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.117648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.118115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.123242 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.123989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.124430 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.149599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:38:14.229957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c6053167-b9f3-4e5a-8074-8e624df4777d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 204 len: 0 microversion: 2.1 time: 0.123698 Aug 31 04:38:14.230660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 253/482] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:38:14 2022] DELETE /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:38:14.239312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:14.240013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:14.242869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:14.246229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.246992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.247131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.247990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.248373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.248812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.254478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:14.256570 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:14.257734 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b0bb34a6-a97d-45f1-a54b-1eb534511452 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.214841 Aug 31 04:38:14.258279 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 230/483] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:14 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:14.330995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:14.332729 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:14.339088 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.339867 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.340517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.341451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.342169 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.342754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.387851 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:14.396083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-781ab49a-7855-4e09-b2b8-f895f34c6c4f tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.160905 Aug 31 04:38:14.396646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 254/484] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:14 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:14.481034 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:14.488996 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-578f9d96-1f0b-437f-ae27-feb3e3181a91 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.163648 Aug 31 04:38:14.489560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 231/485] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:14 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:14.548516 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:14.549314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:14.557168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.557795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.558391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.559334 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:14.559900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:14.560497 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:14.561722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:38:14.561921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Wed Aug 31 04:38:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 (ip 10.222.0.42) !!! Aug 31 04:38:14.695947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:14.703830 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8a65bfad-ae95-40ae-91e6-36a188e10a8a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.160210 Aug 31 04:38:14.704481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 255/486] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:14 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:15.285270 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:15.286228 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:15.296458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.296939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.297375 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.298066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.298511 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.298975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.417140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:15.417772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:15.424462 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.424941 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.425363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.426047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.426486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.426969 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.439312 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:15.448067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:15.449454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:15.450592 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ba941ad2-8fb5-443d-8331-1f9d807a3b14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.172297 Aug 31 04:38:15.451442 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 232/487] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:15 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:15.510311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:15.510922 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:15.517001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.517479 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.517900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.518615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.519083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.519474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.563403 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:15.571296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cbf4f34f-2ce4-4549-8ed4-d4fe664c1638 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.158066 Aug 31 04:38:15.571870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 256/488] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:15 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:15.647407 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:15.657526 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-49252bba-ba10-4d81-840c-b13e32324ccb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.151258 Aug 31 04:38:15.658088 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 233/489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:15 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:15.733523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:15.734526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:15.744819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.745623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.746526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.747854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:15.748542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:15.749156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:15.888921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:15.896890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-894d3a5b-ae94-4de3-bafe-33a6abee3a43 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1314 microversion: 2.1 time: 0.169735 Aug 31 04:38:15.897392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 257/490] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:15 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:16.479840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:16.480781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:16.491935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.492716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.493414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:16.494539 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.495322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.496008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:16.592569 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:16.593149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:16.601380 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.601940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.602435 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:16.603218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.603908 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.604404 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:16.653114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:16.662418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:16.664298 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:16.665448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d272d98-3b81-4837-bf28-7393d19a5f59 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.194848 Aug 31 04:38:16.666211 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 234/491] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:16 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:16.677151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:16.677885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:16.685417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.685924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.686350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:16.687197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.687542 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.687923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:16.765002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:16.774068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f5ab1a8a-4c27-410e-b398-fbf91cf721f3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.185489 Aug 31 04:38:16.775047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 258/492] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:16 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:16.919953 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:16.921255 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:16.928746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.929594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.930230 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:16.931155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:16.931837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:16.932466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:17.047952 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:17.064332 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-70728426-6bb9-4e7a-8500-f16d6b3d008a tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.388422 Aug 31 04:38:17.083606 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 235/493] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:16 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:17.116857 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:17.126902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f9622aa4-8784-4a77-8659-d7c052d82ae7 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1498 microversion: 2.1 time: 0.211483 Aug 31 04:38:17.128105 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 259/494] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:16 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1498 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:17.688021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:17.689508 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:17.699343 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:17.700159 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:17.700876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:17.701966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:17.702456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:17.703398 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:17.796822 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:17.797434 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:17.804324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:17.804805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:17.805391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:17.806259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:17.806904 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:17.807508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:17.872162 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:17.881097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:17.882505 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:17.883686 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d0a242a9-c0ee-4bb8-b8c3-6d65dfe322ad tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.199794 Aug 31 04:38:17.884220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 236/495] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:17 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:17.888862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:17.889345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:17.895792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:17.896269 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:17.896675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:17.897355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:17.897821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:17.898236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:17.923593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:38:17.949251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:17.957088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:17.967674 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8e810d9e-ba70-4f1c-a165-e8e534eb6722 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.174886 Aug 31 04:38:17.968982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 260/496] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:17 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:18.031808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4698adfa-3029-4131-b90f-245efd3001a4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "DELETE /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 204 len: 0 microversion: 2.1 time: 0.146334 Aug 31 04:38:18.032405 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 237/497] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:38:17 2022] DELETE /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:38:18.040786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:18.041392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:18.048357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:18.048838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:18.049267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:18.049969 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:18.050414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:18.050881 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:18.089925 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:18.090614 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:18.097559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:18.098050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:18.098479 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:18.099225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:18.099673 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:18.100095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:18.220712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:18.228912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3af739bc-9dc1-4bf8-a530-be3ca0ef0338 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.192084 Aug 31 04:38:18.229678 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 261/498] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:18 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:18.257785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:18.271185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-48780656-09e9-41da-8ec4-5459c05cf18d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.185306 Aug 31 04:38:18.271767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 238/499] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:18 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:18.907126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:18.907722 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:18.914374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:18.914890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:18.915313 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:18.915994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:18.916434 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:18.916840 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:18.989581 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:18.990204 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:19.004984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:19.005467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:19.005895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:19.008571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:19.009111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:19.009537 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:19.067280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:19.076936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:19.078541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:19.079849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d38ac572-6461-4f2e-bc17-683b6d0c09bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.177169 Aug 31 04:38:19.080406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 262/500] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:18 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:19.172161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:19.182293 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-52d682b4-f297-49eb-b0b5-3fbb71023586 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.196499 Aug 31 04:38:19.182917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 239/501] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:18 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:19.249938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:19.250532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:19.256787 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:19.257259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:19.257679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:19.258406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:19.258862 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:19.259271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:19.296462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:19.297067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:19.314486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:19.314972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:19.315387 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:19.316076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:19.316514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:19.316919 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:19.430260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:19.439260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-eb055e8e-c120-4396-86b6-72e3f3992076 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.192669 Aug 31 04:38:19.447131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 263/502] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:19 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:19.465468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:19.468285 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:19.476783 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6f7df703-9c34-4a11-82c3-1653b2723c2e tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.184050 Aug 31 04:38:19.478751 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 240/503] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:19 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:20.106667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:20.107340 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:20.114454 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.114998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.115408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.116234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.116667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.117078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.205380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:20.205991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:20.213752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.214228 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.214651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.215387 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.215830 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.216247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.251323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:20.262193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:20.263939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:20.265470 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0964f9e7-172b-46c4-8723-7a94c09fdab4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.167529 Aug 31 04:38:20.266369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 264/504] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:20 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:20.384506 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:20.394275 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-38b8296e-6fc2-4760-a8ef-07ea0b3a586d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.194151 Aug 31 04:38:20.394876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 241/505] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:20 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:20.461481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:20.462083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:20.469997 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.470483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.471022 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.471932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.472591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.473244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.500424 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:20.501029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:20.507752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.508232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.508693 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.509609 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:20.510146 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:20.510561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:20.629396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:20.638130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-379ce4bf-63d1-4fc1-be6a-931c69e13713 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.179960 Aug 31 04:38:20.638130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 265/506] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:20 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:20.665897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:20.684358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-70063a91-c606-44e1-a839-3fd9c1fa95c9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.184877 Aug 31 04:38:20.694852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 242/507] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:20 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:21.288269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:21.288912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:21.296081 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.296565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.296993 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.297682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.298135 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.298549 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.416111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:21.416764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:21.424457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.425106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.425754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.432727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.435305 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.439435 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.443851 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:21.460691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:21.462984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:21.465095 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9e655cf7-04c7-428b-8caf-8011954636d2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.180779 Aug 31 04:38:21.466021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 266/508] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:21 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:21.584154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:21.592344 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f9525007-7a76-41b7-a24e-67c95204b86b tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.180140 Aug 31 04:38:21.592881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 243/509] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:21 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:21.674227 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:21.674855 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:21.681437 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.681926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.682349 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.683077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.683516 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.683960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.708680 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:21.709391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:21.729166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.729813 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.730309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.731119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:21.731633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:21.732203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:21.835078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:21.843944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b2fd63f7-f476-4933-b916-c32ce7485624 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.173805 Aug 31 04:38:21.844610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 267/510] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:21 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:21.891523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:21.906904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-10475734-c0cd-4f24-96c9-9632b8563065 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.202292 Aug 31 04:38:21.907663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 244/511] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:21 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:22.178473 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-2b37fa24-9adb-4042-be17-a97d13969465 req-b80e335e-f6e3-46dd-b3fc-48fe265e7e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bafbd2f-51ff-419e-995e-c8455ecd93a7", "name": "network-vif-unplugged", "status": "completed", "tag": "d12da23d-d2c9-4b91-bbfc-4cc391e994f7"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:22.188979 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2b37fa24-9adb-4042-be17-a97d13969465 req-b80e335e-f6e3-46dd-b3fc-48fe265e7e05 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.189438 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2b37fa24-9adb-4042-be17-a97d13969465 req-b80e335e-f6e3-46dd-b3fc-48fe265e7e05 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.189856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2b37fa24-9adb-4042-be17-a97d13969465 req-b80e335e-f6e3-46dd-b3fc-48fe265e7e05 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.200896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-2b37fa24-9adb-4042-be17-a97d13969465 req-b80e335e-f6e3-46dd-b3fc-48fe265e7e05 service nova] Creating event network-vif-unplugged:d12da23d-d2c9-4b91-bbfc-4cc391e994f7 for instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 on hv-cinder-85530 Aug 31 04:38:22.205737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-2b37fa24-9adb-4042-be17-a97d13969465 req-b80e335e-f6e3-46dd-b3fc-48fe265e7e05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031501 Aug 31 04:38:22.206318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 268/512] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:22.492393 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:22.494026 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:22.509206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.514049 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.516713 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.518030 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.521289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.522525 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.619282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:22.620545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:22.631231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.644000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.646172 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.653318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.653892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.654487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.714135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:22.724123 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:22.725532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:22.727111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ba0424fa-6656-42f0-9847-a1c74bc3d6c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.238885 Aug 31 04:38:22.727985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 245/513] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:22 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:38:22.819451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:22.830726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a1b50ea4-e8c9-44b8-8f55-12341e7bc4b2 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.220286 Aug 31 04:38:22.831325 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 269/514] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:22 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:22.865678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:22.866287 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:22.872413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.872883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.873335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.874143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.874591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.875040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.929063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:22.929664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:22.937367 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.937919 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.938275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:22.941935 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:22.942501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:22.943170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:23.037169 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:23.045741 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8e7e97de-c014-4f97-971e-eefb71e65273 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.183917 Aug 31 04:38:23.046809 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 246/515] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:22 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:23.121997 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:23.130369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-462ed9fe-20c8-48b8-af22-fe89287c20e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.205610 Aug 31 04:38:23.130969 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 270/516] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:22 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:23.752520 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:23.753221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:23.759806 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:23.760281 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:23.760705 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:23.761394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:23.761834 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:23.762244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:23.852950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:23.853618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:23.862595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:23.870214 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:23.870821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:23.871624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:23.872145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:23.872620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:23.917091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:23.928073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:23.929620 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:23.930914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fe42c4bd-26d1-4eb2-9199-bd1d0c2a402e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.182781 Aug 31 04:38:23.931564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 247/517] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:23 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:24.030067 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:24.057399 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-02404660-d386-4c95-88b0-2a0325581cb6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.201807 Aug 31 04:38:24.058461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 271/518] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:23 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:24.079907 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:24.080984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:24.088760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:24.090127 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:24.091816 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:24.092832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:24.093593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:24.094116 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:24.156298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:24.157521 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:24.164451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:24.165328 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:24.169304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:24.174994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:24.180101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:24.183639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:24.273493 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:24.281385 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ab8df4c0-630e-4aa1-b6fd-c5758c457956 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.208027 Aug 31 04:38:24.282060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 248/519] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:24 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:24.361968 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:24.370582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6f437483-640b-4877-ae3a-2d088d6c662c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.222900 Aug 31 04:38:24.384735 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 272/520] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:24 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:24.954422 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:24.955047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:24.961550 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:24.962019 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:24.962446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:24.963146 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:24.963584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:24.963992 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:25.081664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:25.082248 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:25.098248 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:25.098816 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:25.099192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:25.099962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:25.100406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:25.100823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:25.104795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:25.114957 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:25.116749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:25.118437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5726e224-696c-4981-9ef5-b544f21a7051 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.168101 Aug 31 04:38:25.128781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 249/521] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:24 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:25.260012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:25.270021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bb956fe3-92c4-4b38-9def-44d34572d343 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.191911 Aug 31 04:38:25.270675 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 273/522] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:25 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:25.302400 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:25.303176 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:25.309305 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:25.309783 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:25.310206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:25.311002 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:25.311422 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:25.311938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:25.392970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:25.393609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:25.399783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:25.400274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:25.400744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:25.401455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:25.401899 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:25.402313 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:25.458913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:25.467158 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-49f8eaa0-c381-425c-aba8-d2528d3bedd4 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.168384 Aug 31 04:38:25.468304 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 250/523] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:25 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:25.562274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:25.572041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8bfb3e18-2c4b-4b20-b4da-ee0cb389531b tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.183262 Aug 31 04:38:25.572690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 274/524] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:25 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:26.143751 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:26.144346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:26.154334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.154943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.155545 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.156492 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.156755 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.157202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.294992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:26.296270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:26.303594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.304460 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.305162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.305893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.306331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.307042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.315816 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:26.328811 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:26.330311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:26.331515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6acb3a64-ac3d-4df7-a5eb-5908c4f82b45 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.191999 Aug 31 04:38:26.332877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 251/525] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:26 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:26.449753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:26.458308 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7f61ab81-acdf-4e92-90f7-0ba703d0968e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.167382 Aug 31 04:38:26.458899 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 275/526] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:26 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:26.489482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:26.490091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:26.496473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.496942 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.497360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.498026 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.498479 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.498940 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.596457 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:26.597552 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:26.601852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:26.609469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.610287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.610866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.611956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:26.612498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:26.613144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:26.642322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:26.650625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-602668b5-b9ca-4a8d-ab8e-1617df3c758a tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.164942 Aug 31 04:38:26.651142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 252/527] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:26 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:26.744807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:26.753546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6aea9d94-6cff-42fc-95ec-b15a0ea993ae tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.162380 Aug 31 04:38:26.754116 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 276/528] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:26 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:27.358628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:27.359246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:27.365807 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.366274 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.366697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.367373 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.367832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.368241 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.480298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:27.480897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:27.487346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.487821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.488244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.488919 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.489354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.489764 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.505221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:27.514370 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:27.515478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:27.516597 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0c058a97-b0aa-419a-8d5d-4ee77b53b816 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.164514 Aug 31 04:38:27.517180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 253/529] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:27 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:27.621736 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:27.630006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bb7ad494-1135-47cd-aa05-8477fcef4ccb tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.153955 Aug 31 04:38:27.630570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 277/530] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:27 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:27.674696 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:27.675697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:27.685495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.686314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.686746 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.687546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.687985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.688394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.775415 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:27.776032 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:27.782880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.783374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.783795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.784488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:27.784928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:27.785342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:27.788101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:27.829001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:27.837119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ecd11ef1-07fb-4e49-a6a5-5d378b95b0e9 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.168116 Aug 31 04:38:27.837691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 254/531] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:27 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:27.912311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:27.920137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5871180e-06f1-4035-9414-9f008414104c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.148911 Aug 31 04:38:27.920998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 278/532] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:27 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:28.134187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bc2d007-afc5-4e51-ac9b-7091e11f275b"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:28.138165 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:28.145375 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.145853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.146280 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:28.146995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.147437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.147848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:28.543355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:28.544257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:28.555183 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.555973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.556680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:28.557804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.558559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.559296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:28.711294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:28.720884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:28.722406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:28.724077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-23bab4a1-f1c7-429f-bc12-0b920ff68483 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.187431 Aug 31 04:38:28.725446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 279/533] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:28 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:28.729934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:28.730541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:28.738579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.738830 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.739157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:28.740373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.740373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.740739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:28.881035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:28.889790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cbead056-114b-42b1-ab6b-8d36e78455d8 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1514 microversion: 2.1 time: 0.163274 Aug 31 04:38:28.890536 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 280/534] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:28 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:28.897814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:28.897814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:28.902312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.902962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.903464 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:28.904220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:28.904672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:28.905123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:29.041946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:29.049944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-eae13701-a687-4dfb-8d1e-3f2526a75851 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.158332 Aug 31 04:38:29.050867 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 281/535] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:28 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:29.055012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:29.055603 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:29.061512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:29.061992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:29.062419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:29.063270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:29.063717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:29.064573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:29.193600 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:29.205993 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fcad27cb-6a02-40f6-8c87-15cf3e3bebb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.154067 Aug 31 04:38:29.206799 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 282/536] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:29 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:29.751688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:29.752396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:29.758853 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:29.759292 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:29.759738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:29.760408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:29.760841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:29.761247 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:29.896653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:29.905390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:29.906877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:29.908069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6ab1ee4e-9497-4c80-b505-9fd525535d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.160619 Aug 31 04:38:29.908625 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 283/537] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:29 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:29.913000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-29df6d9a-c1d6-4fc7-8662-82e49444a7b0 req-c9a624a0-4bf8-4b4f-876f-0f0d7c836bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bafbd2f-51ff-419e-995e-c8455ecd93a7", "name": "network-vif-deleted", "tag": "d12da23d-d2c9-4b91-bbfc-4cc391e994f7"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:29.922441 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-29df6d9a-c1d6-4fc7-8662-82e49444a7b0 req-c9a624a0-4bf8-4b4f-876f-0f0d7c836bd9 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:29.923009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-29df6d9a-c1d6-4fc7-8662-82e49444a7b0 req-c9a624a0-4bf8-4b4f-876f-0f0d7c836bd9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:29.923431 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-29df6d9a-c1d6-4fc7-8662-82e49444a7b0 req-c9a624a0-4bf8-4b4f-876f-0f0d7c836bd9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:29.935289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-29df6d9a-c1d6-4fc7-8662-82e49444a7b0 req-c9a624a0-4bf8-4b4f-876f-0f0d7c836bd9 service nova] Creating event network-vif-deleted:d12da23d-d2c9-4b91-bbfc-4cc391e994f7 for instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 on hv-cinder-85530 Aug 31 04:38:29.940382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-29df6d9a-c1d6-4fc7-8662-82e49444a7b0 req-c9a624a0-4bf8-4b4f-876f-0f0d7c836bd9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Aug 31 04:38:29.940957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 284/538] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:29.949196 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:29.950234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:29.960021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:29.960698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:29.961280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:29.962312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:29.962994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:29.963579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.026223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:30.034515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cea07800-48f9-4042-bb7d-fce7c934b670 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1472 microversion: 2.1 time: 0.091244 Aug 31 04:38:30.035121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 285/539] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:29 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:30.072081 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:30.072824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:30.080742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.081189 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.081608 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.082288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.082750 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.083167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.217940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:30.225907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1a24b523-1746-46f4-8309-7e6da8c31115 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.157732 Aug 31 04:38:30.227094 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 286/540] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:30 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:30.231479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:30.232069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:30.237726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.238194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.238585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.239283 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.239724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.240135 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.584267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:30.594105 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-92aa5fa6-d462-4afa-a8dd-a77457b818fb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.365965 Aug 31 04:38:30.594823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 287/541] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:30 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:30.607839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:30.607839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:30.607839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.607839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.608192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.608192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.608624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.609480 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.703213 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-95953a56-ddae-4348-9fda-e3e3f08f3ba2 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.574434 Aug 31 04:38:30.704802 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 255/542] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:38:28 2022] POST /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments => generated 194 bytes in 2578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:30.767192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lazy-loading 'services' on Instance uuid 37d80f26-ed89-466a-8716-08e48aa7dfb8 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:38:30.915595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-86986dae-2290-4305-852c-1acccbe11d65 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-volume_attachments/0a3edfa6-db83-4766-98c1-b4426395d530" status: 202 len: 0 microversion: 2.1 time: 0.319427 Aug 31 04:38:30.916381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 288/543] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:38:30 2022] DELETE /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-volume_attachments/0a3edfa6-db83-4766-98c1-b4426395d530 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:38:30.935174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:30.936410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:30.946464 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.947346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.948673 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.950078 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:30.951157 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:30.952171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:30.997936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:31.056571 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:31.057682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:31.067240 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.068402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.068930 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.069823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.070443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.071190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.102605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.103367 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.103790 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.104217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lazy-loading 'fault' on Instance uuid 4bafbd2f-51ff-419e-995e-c8455ecd93a7 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:38:31.146059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:31.153769 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d2c28c71-742f-45de-b266-527650dad8d1 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 200 len: 1309 microversion: 2.1 time: 0.101614 Aug 31 04:38:31.154298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 289/544] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:31 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:31.234059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:31.243584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:31.245144 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:31.246453 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-516c197c-5bd7-4edb-ad88-26dd015edacb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.317744 Aug 31 04:38:31.247197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 256/545] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:30 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:31.249470 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:31.250392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:31.257944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.258675 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.259624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.260672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.261557 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.262395 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.419351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffc906c79ba418cbc52e5db5ca991ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a44f3c0ba4230bac2bcb9d4e8ec08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:31.443879 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a64fa133-26f6-4b84-93ab-aaec29052f80 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 200 len: 1504 microversion: 2.1 time: 0.199121 Aug 31 04:38:31.445154 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 290/546] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:31 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:31.615835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:31.616728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:31.623093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.623811 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.624242 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.625256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.625908 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.626357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.794982 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:31.803288 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d034b093-0d1c-4e69-8be5-79e2b7493278 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.191692 Aug 31 04:38:31.803854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 257/547] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:31 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:31.957845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-2baa7368-5398-4b28-9d9e-6dbe4f962323 req-7d5ce1de-07c3-41a4-93d6-1e20844c87f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ccbc34-3498-4aef-b361-e9b51a07e9d2", "name": "network-vif-deleted", "tag": "6cecccca-7742-4933-8fe3-16ec55261d1a"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:31.970193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2baa7368-5398-4b28-9d9e-6dbe4f962323 req-7d5ce1de-07c3-41a4-93d6-1e20844c87f1 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:31.970660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2baa7368-5398-4b28-9d9e-6dbe4f962323 req-7d5ce1de-07c3-41a4-93d6-1e20844c87f1 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:31.971114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-2baa7368-5398-4b28-9d9e-6dbe4f962323 req-7d5ce1de-07c3-41a4-93d6-1e20844c87f1 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:31.982513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-2baa7368-5398-4b28-9d9e-6dbe4f962323 req-7d5ce1de-07c3-41a4-93d6-1e20844c87f1 service nova] Creating event network-vif-deleted:6cecccca-7742-4933-8fe3-16ec55261d1a for instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 on hv-cinder-85530 Aug 31 04:38:31.987342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-2baa7368-5398-4b28-9d9e-6dbe4f962323 req-7d5ce1de-07c3-41a4-93d6-1e20844c87f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033970 Aug 31 04:38:31.987917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 291/548] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:32.175219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:32.176029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 4bafbd2f-51ff-419e-995e-c8455ecd93a7] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:32.182293 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.183029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.183617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.184468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.185240 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.186183 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.200872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] HTTP exception thrown: Instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 could not be found. Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Request method failure captured: Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 HTTP/1.1 Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuVoXsPJoSQOqdx-8q6u2bXx-CunlfY1g6ks6JK4dzHSC6zpkx_p0Jin3Wfx35biyRghJJZyghGfijy9A6U8NggChsMW510oNouGosztgAm0w90X1ZG4vd9A-UYdCJefDoiLopw7qbmkPLKByb-OZ84uoQZivbGw4ejJhihAYhadlS4 Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 52fbe77f79a5449b8fb2bfef82360b94 Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotTestJSON-556530432 Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:38:32.203023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52fbe77f79a5449b8fb2bfef82360b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52fbe77f79a5449b8fb2bfef82360b94", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52fbe77f79a5449b8fb2bfef82360b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52fbe77f79a5449b8fb2bfef82360b94"}]}] Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotTestJSON-556530432 Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 52fbe77f79a5449b8fb2bfef82360b94 Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-556530432 Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotTestJSON-556530432-project Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 503ba8b1d3f64186b188bed35c4baefe Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotTestJSON-556530432-project Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 could not be found. Aug 31 04:38:32.204846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '4bafbd2f-51ff-419e-995e-c8455ecd93a7'} Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 could not be found. Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:38:32.205761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 could not be found. Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 could not be found. Aug 31 04:38:32.207248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.218083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Returning 404 to user: Instance 4bafbd2f-51ff-419e-995e-c8455ecd93a7 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:38:32.218083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4b65aab5-6ee2-4d07-9958-688fc36d79fa tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7" status: 404 len: 111 microversion: 2.1 time: 0.033029 Aug 31 04:38:32.218083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 258/549] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:32 2022] GET /compute/v2.1/servers/4bafbd2f-51ff-419e-995e-c8455ecd93a7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:38:32.278902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:32.279680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:32.292254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.292783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.293211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.294885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.295599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.298503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.466819 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:32.467582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] [instance: 86ccbc34-3498-4aef-b361-e9b51a07e9d2] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:32.468327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:32.475060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.475567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.476005 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.477085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.477641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.478057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.479084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:32.480501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:32.481646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-603a6ed8-2d7f-4874-b680-db3c4dc17d13 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.207149 Aug 31 04:38:32.482327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 292/550] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:32 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:38:32.493663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] HTTP exception thrown: Instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 could not be found. Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Request method failure captured: Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 HTTP/1.1 Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuV1c1vXYu930sPOJ8K4ZrlAeSqBbiBVQ2T0ibjJs-cl2gH9bzXj-r1C4ZLjtIOCB82zNdfJqMQLiNAEoo8ctT_4xGcxzmyuGXW7kQ2Wqp7AFtol-3feZMb34spFxvugrH8_Q-5nYSE-aht1KvG-gzLB0od6jh2LRphTgXQBTAUP3TY Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: b35a44f3c0ba4230bac2bcb9d4e8ec08 Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesActionsTest-1011385237 Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:38:32.495208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35a44f3c0ba4230bac2bcb9d4e8ec08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b35a44f3c0ba4230bac2bcb9d4e8ec08", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b35a44f3c0ba4230bac2bcb9d4e8ec08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35a44f3c0ba4230bac2bcb9d4e8ec08"}]}] Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesActionsTest-1011385237 Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: b35a44f3c0ba4230bac2bcb9d4e8ec08 Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesActionsTest-1011385237 Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesActionsTest-1011385237-project Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: fffc906c79ba418cbc52e5db5ca991ca Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesActionsTest-1011385237-project Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 could not be found. Aug 31 04:38:32.496727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '86ccbc34-3498-4aef-b361-e9b51a07e9d2'} Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 could not be found. Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:38:32.497556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 could not be found. Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 could not be found. Aug 31 04:38:32.498995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:38:32.500324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] Returning 404 to user: Instance 86ccbc34-3498-4aef-b361-e9b51a07e9d2 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:38:32.500324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-805f341f-3062-402c-8674-ca31096b9112 tempest-VolumesActionsTest-1011385237 tempest-VolumesActionsTest-1011385237-project] 10.222.0.42 "GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2" status: 404 len: 111 microversion: 2.1 time: 0.035071 Aug 31 04:38:32.500324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 259/551] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:32 2022] GET /compute/v2.1/servers/86ccbc34-3498-4aef-b361-e9b51a07e9d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:38:32.823840 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:32.824433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:32.830684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.831190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.831615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.832295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:32.832738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:32.833148 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:32.974647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:32.983146 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-10c7a17b-6102-47a3-8da7-4b3ff506c7be tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.162923 Aug 31 04:38:32.983754 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 293/552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:32 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:33.505141 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:33.505742 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:33.512502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:33.512976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:33.513409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:33.514085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:33.514528 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:33.514976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:33.646852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:33.655752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:33.657315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:33.658457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7a0d78eb-544e-4497-b07e-a7ab79d347ee tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.157316 Aug 31 04:38:33.658998 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 260/553] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:33 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:34.005879 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:34.006580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:34.013511 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:34.013999 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:34.014426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:34.015128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:34.015666 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:34.016152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:34.154956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:34.163595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-36f0aaba-d93e-4f24-b514-d79d0e2e3185 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.161636 Aug 31 04:38:34.164445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 294/554] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:34 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:34.683424 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:34.684016 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:34.693008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:34.693483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:34.693902 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:34.694582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:34.695078 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:34.695489 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:34.830971 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:34.839854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:34.841296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:34.842443 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-71880271-1a69-4450-8d12-db48857b258e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.165314 Aug 31 04:38:34.843024 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 261/555] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:34 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:35.188122 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:35.188740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:35.195593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:35.196061 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:35.196481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:35.197157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:35.197600 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:35.198006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:35.200682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:35.334132 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:35.342361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b6259110-b040-4882-a472-b843757d16d1 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.160414 Aug 31 04:38:35.342922 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 295/556] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:35 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:35.866341 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:35.867032 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:35.874282 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:35.874796 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:35.875945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:35.876651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:35.877105 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:35.877521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:36.024227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:36.035662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:36.037063 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:36.038216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ecfd15de-e944-437e-8483-fdf59ac87417 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.176105 Aug 31 04:38:36.038767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 262/557] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:35 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:36.364529 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:36.365130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:36.371952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:36.372430 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:36.372854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:36.373540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:36.373988 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:36.374398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:36.515892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:36.527359 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-464f448a-2e3f-4cfa-8c7d-8cc1fd998304 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.166315 Aug 31 04:38:36.528132 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 296/558] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:36 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:37.065456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:37.066187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:37.075418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:37.075632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:37.076266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:37.077320 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:37.078049 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:37.078919 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:37.214818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:37.224935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:37.226356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:37.227884 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d0b5468f-37ce-4334-91e3-ad8ae5559d74 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.168910 Aug 31 04:38:37.228493 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 263/559] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:37 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:37.551974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:37.552699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:37.560902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:37.561461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:37.561963 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:37.562880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:37.563510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:37.563998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:37.715627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:37.723565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-88405b4c-42dc-43ef-a043-56cab67ba089 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.176542 Aug 31 04:38:37.724154 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 297/560] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:37 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:38.251260 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:38.251818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:38.254235 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:38.259640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:38.260112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:38.260536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:38.261213 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:38.261661 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:38.262072 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:38.392495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:38.401832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:38.403300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:38.404541 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b411116f-d181-494a-8f37-5d1e86384d88 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.157602 Aug 31 04:38:38.405294 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 264/561] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:38 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:38.749109 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:38.750045 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:38.757271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:38.757853 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:38.758182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:38.759035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:38.759486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:38.759905 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:38.891813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:38.901506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8de9bc4e-45aa-48ad-a232-021cc5b028c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.159176 Aug 31 04:38:38.902068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 298/562] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:38 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:39.221787 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c15275d1-92b6-453e-9d60-48a323b74e67 req-54814067-4eec-49c8-9515-47cbc6c3011c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72bff5a-e67f-4494-bdea-4971a277e537", "name": "network-vif-plugged", "status": "completed", "tag": "f13a5355-33c4-4ae4-aaed-4afc34e93d15"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:39.232353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c15275d1-92b6-453e-9d60-48a323b74e67 req-54814067-4eec-49c8-9515-47cbc6c3011c service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:39.232661 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c15275d1-92b6-453e-9d60-48a323b74e67 req-54814067-4eec-49c8-9515-47cbc6c3011c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:39.233062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c15275d1-92b6-453e-9d60-48a323b74e67 req-54814067-4eec-49c8-9515-47cbc6c3011c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:39.246122 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c15275d1-92b6-453e-9d60-48a323b74e67 req-54814067-4eec-49c8-9515-47cbc6c3011c service nova] Creating event network-vif-plugged:f13a5355-33c4-4ae4-aaed-4afc34e93d15 for instance c72bff5a-e67f-4494-bdea-4971a277e537 on hv-cinder-85530 Aug 31 04:38:39.251379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c15275d1-92b6-453e-9d60-48a323b74e67 req-54814067-4eec-49c8-9515-47cbc6c3011c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Aug 31 04:38:39.252284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 265/563] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:39.431116 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:39.432082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:39.440805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:39.441280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:39.441689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:39.442631 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:39.443047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:39.443424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:39.579812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:39.590199 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:39.591718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:39.592870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-abda3357-2cd1-4a34-b376-569c67b278c5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.167994 Aug 31 04:38:39.593429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 299/564] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:39 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:39.924653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:39.925639 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:39.932718 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:39.933472 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:39.934594 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:39.935521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:39.936416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:39.937425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:40.106429 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:40.117510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f2be610a-0a1b-4be7-8ac9-674b5e6be255 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.198675 Aug 31 04:38:40.131333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 266/565] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:39 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:40.524879 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:40.528059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:40.536293 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:40.537047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:40.537676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:40.538838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:40.539457 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:40.539926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:40.567124 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lazy-loading 'flavor' on Instance uuid 543cfc4e-7580-4e55-999c-9bb37cbfca94 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:38:40.620196 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:40.621624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:40.630417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:40.631084 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:40.631649 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:40.632504 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:40.633088 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:40.634241 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:40.797932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-24c84ed9-9e0d-4e69-9ab1-4541a508290e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/action" status: 200 len: 32 microversion: 2.1 time: 0.276671 Aug 31 04:38:40.806885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 300/566] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:38:40 2022] POST /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:38:40.809356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:40.818984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:40.820190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:40.827406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:40.827993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:40.828326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:40.829006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:40.830002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:40.830126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:40.830747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:40.831322 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:40.831716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4378c13b-f512-46eb-b3d4-81f2736997f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.216191 Aug 31 04:38:40.832510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 267/567] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:40 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:38:41.001322 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:41.012466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bea8bac7-38f2-42ac-9dcf-6c0e205a98e7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.203309 Aug 31 04:38:41.013287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 301/568] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:40 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:41.140834 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:41.141539 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:41.150255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:41.150766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:41.151405 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:41.152277 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:41.152893 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:41.153500 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:41.357577 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:41.366952 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f3d905e7-657f-431d-89fa-3aeaf20862d9 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.230039 Aug 31 04:38:41.367537 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 268/569] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:41 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:41.864011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:41.865268 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:41.872326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:41.873162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:41.873593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:41.874282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:41.874750 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:41.875165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:42.033967 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:42.035388 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:42.038087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:42.046880 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:42.048595 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:42.049672 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:42.050162 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:42.051914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:42.052190 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:42.053290 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3ed6e154-1fb0-405a-b1f5-df2dbd4aa6a2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.195139 Aug 31 04:38:42.053757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:42.055294 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:42.068264 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 302/570] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:41 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:42.246609 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:42.266999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-59349f7b-636d-4519-8d3f-48a17ebf944c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.236668 Aug 31 04:38:42.268607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 269/571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:42 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:42.397602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:42.398325 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:42.404806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:42.405387 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:42.406127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:42.407201 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:42.408106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:42.408724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:42.572125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:42.586778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0329bd0c-3fb2-4cd3-8c19-a297f8ec5792 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.191555 Aug 31 04:38:42.586778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 303/572] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:42 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:43.079232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:43.079946 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:43.086697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:43.087609 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:43.088397 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:43.089444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:43.090089 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:43.090701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:43.250381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:43.260232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:43.263292 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:43.265284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-11bd5f72-b4ae-41c1-ba0a-1f596ff34d1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.190244 Aug 31 04:38:43.265972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 270/573] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:43 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:43.288730 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:43.289362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:43.300229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:43.300712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:43.301137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:43.302006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:43.302467 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:43.302951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:43.458701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:43.470024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3b6977a4-3ac6-4f8a-b746-9007cd7474c7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.185149 Aug 31 04:38:43.470961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 304/574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:43 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:43.606623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:43.607256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:43.613759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:43.614247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:43.614697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:43.615449 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:43.615904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:43.616333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:43.811063 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:43.820463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9845f615-23f7-41ab-80c8-13a7cd7c5733 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1358 microversion: 2.1 time: 0.217842 Aug 31 04:38:43.821792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 271/575] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:43 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:44.288854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:44.289477 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:44.296012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:44.296772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:44.297433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:44.298210 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:44.298691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:44.299130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:44.491798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:44.492399 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:44.499220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:44.499957 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:44.500562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:44.501836 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:44.502446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:44.503174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:44.529923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:44.538747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:44.540167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:44.541339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9e4aee98-34c8-4df6-bc61-3f01da2283e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.256486 Aug 31 04:38:44.551008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 305/576] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:44 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:38:44.569363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1151245607", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "networks": [{"uuid": "432503fc-5225-4e38-b2a8-672138c90cb1"}]}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:44.638879 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] validate_networks() for [('432503fc-5225-4e38-b2a8-672138c90cb1', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:38:44.704411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:44.713343 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2bd3732d-cfd1-4983-872d-2a9e19a8441b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.225415 Aug 31 04:38:44.713909 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 272/577] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:44 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:44.843051 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:44.846445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:44.872249 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:44.872772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:44.873144 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:44.873840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:44.874281 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:44.874689 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.141102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.153861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-681c4def-51e9-48b1-8b99-2035803a9d89 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1548 microversion: 2.1 time: 0.311841 Aug 31 04:38:45.155656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 273/578] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:44 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1548 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:45.160974 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ad1f0c5c-5275-4dab-b47f-a043e2b6fd11 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:45.168118 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c5c-5275-4dab-b47f-a043e2b6fd11 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.169413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c5c-5275-4dab-b47f-a043e2b6fd11 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.170007 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad1f0c5c-5275-4dab-b47f-a043e2b6fd11 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.209667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ad1f0c5c-5275-4dab-b47f-a043e2b6fd11 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Going to try to stop instance {{(pid=127198) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 04:38:45.215917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:45.241551 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:38:45.242487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:38:45.242487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:38:45.242882 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:38:45.243560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:38:45.255008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.255959 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.256180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.256900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.257343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.257752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.279055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ad1f0c5c-5275-4dab-b47f-a043e2b6fd11 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action" status: 202 len: 0 microversion: 2.1 time: 0.121612 Aug 31 04:38:45.279622 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Getting quotas for project 52fbe77f79a5449b8fb2bfef82360b94. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:38:45.279765 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 274/579] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:38:45 2022] POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:38:45.285451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Getting quotas for user 503ba8b1d3f64186b188bed35c4baefe and project 52fbe77f79a5449b8fb2bfef82360b94. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:38:45.305625 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:38:45.308035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:38:45.308540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:45.311389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:45.326976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.327636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.328079 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.331482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.332334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.334161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.367668 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-210361dd-a00a-45fc-ba86-69ecff302c9e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802252 Aug 31 04:38:45.375357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 306/580] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 04:38:45.381036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:45.381886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:45.388845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.389551 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.390147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.391073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.392774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.394172 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.578145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.586766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-551f8b3c-b00e-4556-8653-4f95eb2e8cd6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1548 microversion: 2.1 time: 0.296973 Aug 31 04:38:45.590633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 275/581] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:45 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1548 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:45.616481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3adfef8c-6096-4406-a518-0a703bd539ba tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:45.618929 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3adfef8c-6096-4406-a518-0a703bd539ba tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:45.657246 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.666161 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3e4f1ea2-ec52-424a-80df-c038a64736a6 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.288856 Aug 31 04:38:45.666858 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 307/582] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:45 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:45.685856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-895230e0-285d-46c6-ba67-9d25032595ea req-b34c8f02-fd54-4a5d-a03f-7c9d487a29ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ba9256-6be0-49de-8c61-4454227a18c8", "name": "network-vif-plugged", "status": "completed", "tag": "f3809b0b-8437-4e98-88a3-a530ac0d92f8"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:45.696151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-895230e0-285d-46c6-ba67-9d25032595ea req-b34c8f02-fd54-4a5d-a03f-7c9d487a29ac service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.696736 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-895230e0-285d-46c6-ba67-9d25032595ea req-b34c8f02-fd54-4a5d-a03f-7c9d487a29ac service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.697230 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-895230e0-285d-46c6-ba67-9d25032595ea req-b34c8f02-fd54-4a5d-a03f-7c9d487a29ac service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.710612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-895230e0-285d-46c6-ba67-9d25032595ea req-b34c8f02-fd54-4a5d-a03f-7c9d487a29ac service nova] Creating event network-vif-plugged:f3809b0b-8437-4e98-88a3-a530ac0d92f8 for instance 16ba9256-6be0-49de-8c61-4454227a18c8 on hv-cinder-85530 Aug 31 04:38:45.715944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-895230e0-285d-46c6-ba67-9d25032595ea req-b34c8f02-fd54-4a5d-a03f-7c9d487a29ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034785 Aug 31 04:38:45.717047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 308/583] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:45.722851 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:45.723769 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:45.731827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.732390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.732897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.733804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.734629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.735416 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.748780 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3adfef8c-6096-4406-a518-0a703bd539ba tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.757466 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3adfef8c-6096-4406-a518-0a703bd539ba tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1219 microversion: 2.1 time: 0.157376 Aug 31 04:38:45.757964 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 276/584] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:45 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:45.783139 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:45.789417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.790548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Searching by: {'deleted': False, 'project_id': '6714373199f5419a9a70267187067934'} {{(pid=127198) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 04:38:45.799584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.800649 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.801298 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.802307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.802850 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.803316 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:45.940420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.948192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.multi_cell_list [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127198) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 04:38:45.955292 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.959865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:45.961978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b9fd5752-3667-40d0-b6d8-5885c6c0a53d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.242642 Aug 31 04:38:45.964020 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 309/585] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:45 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:45.982158 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:45.983598 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:45.996365 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:45.997998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:45.998537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.000702 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:46.001514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:46.002044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.094269 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0df9f476-414c-407c-890f-acdbecd205cb tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.315346 Aug 31 04:38:46.095326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 277/586] 10.222.0.42 () {58 vars in 1125 bytes} [Wed Aug 31 04:38:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:46.114771 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:46.115652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:46.122950 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:46.123434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:46.123861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.124559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:46.140101 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:46.140548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.192644 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:46.218047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-93d650b3-800c-4f5f-9ff1-490ff9e46da3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.252327 Aug 31 04:38:46.219882 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 310/587] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:45 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:46.368993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:46.377370 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4a719f67-6b69-4596-be93-4b12fda99495 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1548 microversion: 2.1 time: 0.269731 Aug 31 04:38:46.378164 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 278/588] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:46 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:46.697004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:46.699009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:46.711034 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:46.712583 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:46.713357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.714374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:46.715011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:46.715428 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.721851 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:46.781752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:46.783021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:46.801273 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:46.801736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:46.802167 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.802910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:46.803355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:46.803767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:46.909217 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:46.922317 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d5fe36b0-d996-46f9-937a-0c206c3d5358 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1271 microversion: 2.1 time: 0.144077 Aug 31 04:38:46.926805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 279/589] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:46 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:46.979483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:46.990459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:46.991320 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:46.992835 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4afc8d5e-12e9-4c75-b3ec-694558f1da81 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.303810 Aug 31 04:38:46.999713 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:47.000405 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:47.001145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:47.002282 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:47.002912 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:47.003496 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:47.007767 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 311/590] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:46 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:47.138832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:47.147771 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:47.149362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:47.150666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f7c0d3d0-442a-49af-9196-69c1521ec1f2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.166091 Aug 31 04:38:47.151365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 280/591] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:46 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:38:47.241397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:47.241991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:47.248087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:47.248555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:47.248965 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:47.249651 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:47.250088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:47.251088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:47.394287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:47.407683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2b523f83-9fd5-4d78-87ce-09d4ff38994a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.169692 Aug 31 04:38:47.408692 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 312/592] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:47 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:47.954812 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:47.956930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:47.966377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:47.967767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:47.969923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:47.971621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:47.972315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:47.972970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.014060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:48.015106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:48.024449 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.053495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.054460 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.055791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.056735 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.057500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.115227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:48.124227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4cd05bbd-914d-431a-830e-1adef03a319a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1271 microversion: 2.1 time: 0.175089 Aug 31 04:38:48.139341 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 281/593] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:47 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:48.146031 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15260bb0-cc2a-4774-9cbc-cb6c521b8997"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:48.148703 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:48.155647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.156163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.156600 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.157392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.157897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.158534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.302322 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:48.316046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5270dd27-fa1c-49c6-90b4-c0d54f352ac2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.305628 Aug 31 04:38:48.317005 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 313/594] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:48 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:48.323067 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:48.323668 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:48.329878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.330455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.331039 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.331799 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.332357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.332774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.501669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:48.511892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:48.514172 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:48.516120 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-28fe1d4f-0940-4fce-a512-0d9b81899cd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1808 microversion: 2.20 time: 0.198057 Aug 31 04:38:48.517245 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 314/595] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:48 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:38:48.526466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:48.527105 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:48.535661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.536346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.536937 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.537825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:48.538422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:48.539018 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:48.723532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:48.735231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-606563c9-f5c0-4488-825f-3ed007deb0e6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.216379 Aug 31 04:38:48.742795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 315/596] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:48 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:49.044892 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cb427acb-55fd-4436-8baf-1ce427996021 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904171 Aug 31 04:38:49.046023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 282/597] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:38:48 2022] POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:49.151690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:49.152286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:49.167651 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.168711 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.169220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:49.170533 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.171223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.174657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:49.289346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:49.297967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4c74a8c6-2946-44f6-8327-42721b8db24a tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1277 microversion: 2.1 time: 0.150566 Aug 31 04:38:49.300612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 316/598] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:49 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:49.338016 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:49.339034 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:49.350151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.351749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.352725 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:49.355537 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.356170 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.356742 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:49.539676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:49.540310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:49.556298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.556789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.557218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:49.557926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.558375 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.558814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:49.632591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:49.649248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2c12ff9b-1632-4ef1-84b6-ad5dc10956d4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.315380 Aug 31 04:38:49.667450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 283/599] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:49 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:49.716441 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:49.726118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:49.728450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:49.729967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-850d9261-2d03-4494-89d4-0f35ff0ee71e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1795 microversion: 2.20 time: 0.194196 Aug 31 04:38:49.730774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 317/600] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:38:49 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1795 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:38:49.763795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:49.764785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:49.779042 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.780010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.780662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:49.781625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:49.782319 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:49.783010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:50.154130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:50.164033 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-45eb1089-4685-4b8b-804d-16b7c07fcc12 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.404489 Aug 31 04:38:50.178304 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 284/601] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:49 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:50.322057 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:50.323304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:50.328817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:50.331272 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:50.331946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:50.332702 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:50.333569 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:50.334163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:50.334793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:50.502490 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:50.515229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-29075457-0e3c-42fa-b58e-7a8a3fe3d7b3 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.197404 Aug 31 04:38:50.528813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 318/602] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:50 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:50.674481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:50.675427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:50.683945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:50.684879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:50.685490 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:50.686544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:50.687043 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:50.687776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:51.185621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:51.186684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:51.193433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:51.193915 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:51.194338 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:51.195093 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:51.195543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:51.195960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:51.309575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:51.322530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4b90d1df-5759-41c6-a2ad-36a1f6ea7ab3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.653024 Aug 31 04:38:51.328201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 285/603] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:50 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:51.385697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:51.394709 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-07c188aa-95c0-42a2-9232-72d9ff48cc60 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.213187 Aug 31 04:38:51.399014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 319/604] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:51 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:51.538138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:51.539117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:51.552888 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:51.554143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:51.554936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:51.556269 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:51.556897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:51.557464 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:51.717795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-0907c72c-5804-482e-9110-4094d538ef8f req-9b95d99f-945e-417f-afca-64b9d4abf9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b", "tag": "5b34b2d3-f935-4783-8084-46f282724dca"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:51.732873 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0907c72c-5804-482e-9110-4094d538ef8f req-9b95d99f-945e-417f-afca-64b9d4abf9f8 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:51.733740 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0907c72c-5804-482e-9110-4094d538ef8f req-9b95d99f-945e-417f-afca-64b9d4abf9f8 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:51.734439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0907c72c-5804-482e-9110-4094d538ef8f req-9b95d99f-945e-417f-afca-64b9d4abf9f8 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:51.758418 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-0907c72c-5804-482e-9110-4094d538ef8f req-9b95d99f-945e-417f-afca-64b9d4abf9f8 service nova] Creating event network-changed:5b34b2d3-f935-4783-8084-46f282724dca for instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b on hv-cinder-85530 Aug 31 04:38:51.765937 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-0907c72c-5804-482e-9110-4094d538ef8f req-9b95d99f-945e-417f-afca-64b9d4abf9f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051636 Aug 31 04:38:51.767447 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 320/605] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:38:51.826848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:51.840703 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ac1fef7e-d606-4174-bb50-f2790155317c tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.307695 Aug 31 04:38:51.849588 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 286/606] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:51 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:52.372869 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:52.377272 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:52.400182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:52.400741 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:52.401143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:52.410525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:52.411545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:52.411986 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:52.420657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:52.421480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:52.443555 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:52.445252 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:52.445769 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:52.446556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:52.447565 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:52.448040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:52.639461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:52.651214 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-81498839-ae5b-4377-889d-d0cb432c8655 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.301456 Aug 31 04:38:52.653322 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 321/607] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:52 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:52.706648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:52.734198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-afc248ed-0270-4399-a268-5ad2e6120058 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.315125 Aug 31 04:38:52.739161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 287/608] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:52 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:52.865220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:52.865979 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:52.873231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:52.873994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:52.874778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:52.875917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:52.876558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:52.878579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:53.020977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:53.029320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8f34c622-636a-4d7a-a284-06cc6dd2147d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.168185 Aug 31 04:38:53.029875 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 322/609] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:52 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:38:53.675805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:53.676402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:53.683034 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:53.683722 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:53.684331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:53.685181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:53.685860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:53.686284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:53.777769 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:53.778479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:53.787128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:53.787996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:53.788573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:53.789526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:53.789978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:53.790548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:53.896559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:53.906145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dadd62f9-2f74-4349-bce4-124df5b3f871 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.234247 Aug 31 04:38:53.909975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 288/610] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:53 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:53.962818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:53.973098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9a91826e-41b9-42ef-bc07-581feb95ff85 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.210367 Aug 31 04:38:53.988520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 323/611] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:53 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:54.049609 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:54.051597 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:54.059262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:54.059989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:54.060597 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:54.061470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:54.062025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:54.062445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:54.223063 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:54.226146 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:54.234178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3f5e8f68-6dc2-4e75-84fa-83c21dd607ae tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.188362 Aug 31 04:38:54.234956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 289/612] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:54 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:54.929537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:54.930837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:54.937657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:54.938133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:54.938812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:54.939499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:54.940019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:54.940538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:54.996376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:54.997017 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:55.005293 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:55.005837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:55.006452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:55.007375 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:55.008013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:55.008622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:55.127059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:55.136560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-62c5f082-6729-417d-966c-ab0d6da58c5d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.210781 Aug 31 04:38:55.137817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 324/613] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:54 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:55.181547 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:55.190843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c6a125e6-9f82-47ed-84a2-85d25472f96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.198819 Aug 31 04:38:55.191432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 290/614] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:54 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:55.258000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:55.258949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:55.265746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:55.266412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:55.267065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:55.268147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:55.268762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:55.269351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:55.270063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:55.294640 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=6 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:55.439802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:55.448642 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-002c1532-1c89-437f-ae6f-2cf7239ff9d9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.194504 Aug 31 04:38:55.449453 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 325/615] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:55 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:56.158371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:56.159657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:56.167075 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:56.169501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:56.171898 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.172801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.173578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.174881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.175589 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.176321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.212760 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:56.214075 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:56.223161 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.233038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.233591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.234528 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.235029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.235497 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.358278 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:56.370542 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b815aea-d8ee-4c9e-98dc-3aa5204fa5a1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.216527 Aug 31 04:38:56.382752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 291/616] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:56 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:56.424901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:56.433923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-22abe576-e6cb-460c-bb88-5a7b4bb3a69b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.225026 Aug 31 04:38:56.434501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 326/617] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:56 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:56.477744 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:56.478351 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:56.484539 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.485021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.485552 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.486251 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.486696 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.487134 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.632454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:56.641386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-102f2059-d095-48da-89e9-d11755e38b99 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.169414 Aug 31 04:38:56.642131 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 292/618] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:56 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:56.821349 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:56.822009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:56.828099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.828513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.828939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.829669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:56.830293 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:56.830705 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:56.960616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:56.971110 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-35fe15fd-6f80-49b9-af02-b9889d741739 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1594 microversion: 2.1 time: 0.153888 Aug 31 04:38:56.971693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 327/619] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:56 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:57.396082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:57.396787 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:57.403593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:57.404257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:57.404837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:57.405713 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:57.406649 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:57.407277 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:57.457169 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:57.458600 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:57.466010 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:57.466498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:57.466957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:57.467837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:57.468438 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:57.469046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:57.492505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:57.632760 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:57.641596 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3e07ae54-c5e9-4a70-a056-bb6d350c47e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.189042 Aug 31 04:38:57.642200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 328/620] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:57 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:57.647782 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:57.655660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5ae549e5-952c-41b4-929d-3a9da807f092 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.263288 Aug 31 04:38:57.656117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 293/621] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:57 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:57.672224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:57.672831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:57.679333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:57.679816 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:57.680234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:57.680926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:57.681357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:57.681766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:57.833909 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:57.842481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-26683db4-f385-4579-9ce1-1e4fd009413e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.176678 Aug 31 04:38:57.843084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 329/622] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:57 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:58.663099 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:58.664366 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:58.670961 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:58.671534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:58.671963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:58.672869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:58.673147 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:58.673564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:58.677488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:58.678662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:58.685670 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:58.686156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:58.686584 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:58.687346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:58.687793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:58.688191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:58.821874 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:58.830182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e50ef90b-18f2-4364-8850-f7e68e859e13 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.157381 Aug 31 04:38:58.830762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 330/623] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:58 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:58.869167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:58.869771 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:58.875944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:58.876404 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:58.876828 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:58.877514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:58.877952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:58.878360 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:58.905259 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:58.915257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f7cb1f54-da15-4603-9609-0360a940cbf5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.255821 Aug 31 04:38:58.916152 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 294/624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:58 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:59.014446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:38:59.022087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-215cf818-f0ef-497a-9e59-895fbf691b66 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.161727 Aug 31 04:38:59.022612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 331/625] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:58 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:38:59.496966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-cb1bbd54-20e9-4ed5-89ee-49454ee9bc00 req-5c26e22e-8430-441a-90eb-d922eff432c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72bff5a-e67f-4494-bdea-4971a277e537", "tag": "f13a5355-33c4-4ae4-aaed-4afc34e93d15"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:59.514124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cb1bbd54-20e9-4ed5-89ee-49454ee9bc00 req-5c26e22e-8430-441a-90eb-d922eff432c8 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:59.518487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cb1bbd54-20e9-4ed5-89ee-49454ee9bc00 req-5c26e22e-8430-441a-90eb-d922eff432c8 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:59.519002 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cb1bbd54-20e9-4ed5-89ee-49454ee9bc00 req-5c26e22e-8430-441a-90eb-d922eff432c8 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:59.533256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-cb1bbd54-20e9-4ed5-89ee-49454ee9bc00 req-5c26e22e-8430-441a-90eb-d922eff432c8 service nova] Creating event network-changed:f13a5355-33c4-4ae4-aaed-4afc34e93d15 for instance c72bff5a-e67f-4494-bdea-4971a277e537 on hv-cinder-85530 Aug 31 04:38:59.539954 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-cb1bbd54-20e9-4ed5-89ee-49454ee9bc00 req-5c26e22e-8430-441a-90eb-d922eff432c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047398 Aug 31 04:38:59.541171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 295/626] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:59.711178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-7f0288a5-e1fe-4f5e-a2a8-820cc4573641 req-e2c5d167-87af-485d-8edb-1a937732bdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b", "name": "network-vif-plugged", "status": "completed", "tag": "5b34b2d3-f935-4783-8084-46f282724dca"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:38:59.728421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7f0288a5-e1fe-4f5e-a2a8-820cc4573641 req-e2c5d167-87af-485d-8edb-1a937732bdf4 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:59.729077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7f0288a5-e1fe-4f5e-a2a8-820cc4573641 req-e2c5d167-87af-485d-8edb-1a937732bdf4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:59.729641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7f0288a5-e1fe-4f5e-a2a8-820cc4573641 req-e2c5d167-87af-485d-8edb-1a937732bdf4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:59.742579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-7f0288a5-e1fe-4f5e-a2a8-820cc4573641 req-e2c5d167-87af-485d-8edb-1a937732bdf4 service nova] Creating event network-vif-plugged:5b34b2d3-f935-4783-8084-46f282724dca for instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b on hv-cinder-85530 Aug 31 04:38:59.748460 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-7f0288a5-e1fe-4f5e-a2a8-820cc4573641 req-e2c5d167-87af-485d-8edb-1a937732bdf4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046798 Aug 31 04:38:59.749213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 332/627] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:38:59.852104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:59.853149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:59.860355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:59.861664 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:59.863134 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:59.864058 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:59.864830 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:59.865454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:59.936126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:38:59.936695 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:38:59.943435 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:59.944280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:59.944986 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:38:59.945927 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:38:59.946602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:38:59.947438 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:00.103665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:00.113535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1e0126a7-84b7-4fac-b01a-b7caf7e8f8fd tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.181677 Aug 31 04:39:00.114125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 333/628] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:59 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:39:00.120033 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:00.121182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:00.129260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:00.129834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:00.130327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:00.131316 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:00.131831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:00.132353 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:00.292078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:00.307852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bcb8a9d5-1410-4237-9225-e6c8764b9700 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.192257 Aug 31 04:39:00.310951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 334/629] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:00 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:00.405900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:00.415173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e8c31a3e-d073-4cad-8731-38d2e33556c5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1676 microversion: 2.1 time: 0.567009 Aug 31 04:39:00.426205 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 296/630] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:38:59 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1676 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:01.135074 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:01.135697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:01.143074 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.143560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.143985 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.144684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.145126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.145536 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.216883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-313759306"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:01.218240 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:01.225606 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.226090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.226520 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.227614 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.228362 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.228785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.302894 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:01.311260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-dff81d8a-a8b2-422f-89a9-0a57f6d9c23b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.180227 Aug 31 04:39:01.311829 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 335/631] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:01 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:01.329115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:01.330023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:01.336232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.336704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.337124 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.337806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.338243 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.338652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.408431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.network.security_group_api [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Adding security group 391ea4e1-6b88-4738-93fb-5e7cfd7a3dad to port f13a5355-33c4-4ae4-aaed-4afc34e93d15 Aug 31 04:39:01.478165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:01.486957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-634602a2-5014-413e-b871-4abc1318623d tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1319 microversion: 2.1 time: 0.161241 Aug 31 04:39:01.487527 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 336/632] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:01 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:01.492628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:01.493215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:01.500641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.501110 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.501789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.502484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.502950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.503761 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.640536 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:01.649232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-de3d1047-e810-48ed-8d95-c8938210bec1 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1653 microversion: 2.1 time: 0.160481 Aug 31 04:39:01.649808 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 337/633] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:01 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:01.670528 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c668ffbb-6aa1-4fbb-8d4e-bb290010957f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:01.676972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c668ffbb-6aa1-4fbb-8d4e-bb290010957f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.677449 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c668ffbb-6aa1-4fbb-8d4e-bb290010957f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.677871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c668ffbb-6aa1-4fbb-8d4e-bb290010957f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.701011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c668ffbb-6aa1-4fbb-8d4e-bb290010957f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Going to try to start instance {{(pid=127197) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 04:39:01.746129 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c668ffbb-6aa1-4fbb-8d4e-bb290010957f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action" status: 202 len: 0 microversion: 2.1 time: 0.079225 Aug 31 04:39:01.746758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 338/634] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:39:01 2022] POST /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 04:39:01.756258 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:01.756942 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:01.763445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.763913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.764331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.765006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.765529 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.765945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.787984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2539f4ae-6581-4d5f-a1d0-14a6522c9ec3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/action" status: 202 len: 0 microversion: 2.1 time: 0.575155 Aug 31 04:39:01.792353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 297/635] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:39:01 2022] POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 04:39:01.797332 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-06bd6d91-e6f8-4562-9207-2812254f73f4 req-8ba5c7be-7f3a-4184-bd78-b636c44a74e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72bff5a-e67f-4494-bdea-4971a277e537", "tag": "f13a5355-33c4-4ae4-aaed-4afc34e93d15"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:01.807633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-06bd6d91-e6f8-4562-9207-2812254f73f4 req-8ba5c7be-7f3a-4184-bd78-b636c44a74e7 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.808092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-06bd6d91-e6f8-4562-9207-2812254f73f4 req-8ba5c7be-7f3a-4184-bd78-b636c44a74e7 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.808675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-06bd6d91-e6f8-4562-9207-2812254f73f4 req-8ba5c7be-7f3a-4184-bd78-b636c44a74e7 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.824717 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-06bd6d91-e6f8-4562-9207-2812254f73f4 req-8ba5c7be-7f3a-4184-bd78-b636c44a74e7 service nova] Creating event network-changed:f13a5355-33c4-4ae4-aaed-4afc34e93d15 for instance c72bff5a-e67f-4494-bdea-4971a277e537 on hv-cinder-85530 Aug 31 04:39:01.829954 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-06bd6d91-e6f8-4562-9207-2812254f73f4 req-8ba5c7be-7f3a-4184-bd78-b636c44a74e7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036027 Aug 31 04:39:01.830868 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 298/636] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:39:01.836811 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:01.837662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:01.844145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.845003 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.845749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.846632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:01.847282 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:01.847874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:01.941596 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:01.949596 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b2cac5fb-09c8-4983-bfce-6f663b77fc66 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1662 microversion: 2.1 time: 0.197271 Aug 31 04:39:01.952077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 339/637] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:01 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1662 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:02.009630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:02.018218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6dbb11fc-9340-4ea5-9ba6-a2283da38992 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1758 microversion: 2.1 time: 0.185980 Aug 31 04:39:02.018816 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 299/638] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:01 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:02.336476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:02.337112 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:02.343440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.343925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.344355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:02.345085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.345505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.345949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:02.503546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:02.509388 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:02.510284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:02.513411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e045e8b6-c840-49dc-af27-46eb18003e47 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.180902 Aug 31 04:39:02.514321 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 340/639] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:02 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:02.523289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.523828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.525882 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:02.526885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.527474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.527926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:02.811175 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:02.819699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-58c4a8aa-e4f8-47e7-b367-f4569e337ba6 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1508 microversion: 2.1 time: 0.315243 Aug 31 04:39:02.820290 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 300/640] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:02 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:39:02.841002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24420423-4eca-4697-9188-8613f3ac6d1f", "device": "/dev/sdb"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:02.843700 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:02.850555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.851099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.851535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:02.852239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.853036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.853450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:02.971684 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:02.973087 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:02.979763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.980270 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.980881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:02.981763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:02.982453 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:02.982938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:03.141795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8127a42a-1f35-4c3c-b192-7a26ff7b11c5 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "POST /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304496 Aug 31 04:39:03.146338 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 341/641] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:39:02 2022] POST /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:39:03.287991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:03.296069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1613ccfd-c6d6-410e-b19e-5961af03aaec tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1662 microversion: 2.1 time: 0.328512 Aug 31 04:39:03.296644 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 301/642] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:02 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1662 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:39:03.537831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:03.538456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:03.545535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:03.546014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:03.546439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:03.547161 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:03.547603 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:03.548015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:03.686945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:03.695524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-631f203a-c438-417c-8eb0-12cac51626c5 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.162125 Aug 31 04:39:03.696087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 342/643] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:03 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:04.326208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:04.327181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:04.338371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:04.339209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:04.339903 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:04.340985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:04.341709 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:04.342354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:04.478228 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:04.486075 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6338640b-66e8-4166-b304-49d9db5549a9 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1666 microversion: 2.1 time: 0.172194 Aug 31 04:39:04.486678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 302/644] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:04 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1666 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:04.716687 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:04.717290 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:04.724182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:04.724665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:04.725089 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:04.725828 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:04.726237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:04.726634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:04.744064 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:04.866896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:04.878936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d439a3d8-d400-4094-80ed-328caf234896 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.166070 Aug 31 04:39:04.879475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 343/645] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:04 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:05.900762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:05.901358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:05.908322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:05.908798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:05.909344 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:05.910291 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:05.910959 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:05.911528 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:06.057187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:06.066987 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bc95d09e-aa39-4e46-92ee-4ae32619bce9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.170128 Aug 31 04:39:06.067571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 303/646] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:05 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:07.088732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:07.089330 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:07.096454 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:07.096904 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:07.097362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:07.098044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:07.098462 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:07.098946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:07.241193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:07.249970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-170fcff4-1e87-4283-ae6d-a81f7510470f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.165159 Aug 31 04:39:07.250563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 344/647] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:07 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:08.276119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:08.277117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:08.281231 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=82 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:08.291584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:08.292361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:08.293069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:08.294199 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:08.294994 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:08.295682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:08.444360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:08.453084 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e322b805-3a81-46b8-80d2-357b7dd5e2f4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.183654 Aug 31 04:39:08.453651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 304/648] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:08 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:09.475386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:09.475923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:09.482935 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:09.483422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:09.483854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:09.484570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:09.485015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:09.485433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:09.620264 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:09.628889 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a51650bc-c394-4f39-b4ca-90b48348a2d7 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.157721 Aug 31 04:39:09.629424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 345/649] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:09 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:10.649840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:10.650455 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:10.657436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:10.657913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:10.658336 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:10.659048 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:10.659560 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:10.659976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:10.808880 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:10.818677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0c397dc2-b95d-43ce-b031-bff0390674fe tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.172723 Aug 31 04:39:10.819307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 305/650] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:10 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:11.839914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:11.840523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:11.847479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:11.847953 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:11.848362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:11.849352 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:11.849792 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:11.850202 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:11.987103 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:11.996126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-815ddc2f-32d0-4bd9-ab27-4da1dbf62d6e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.160122 Aug 31 04:39:11.996690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 346/651] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:11 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:13.021376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:13.021941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:13.028921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:13.029394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:13.029815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:13.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:13.030977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:13.031389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:13.172508 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:13.181090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0b794b28-d4ae-4f6f-9ce7-c0c74064f5bb tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.166113 Aug 31 04:39:13.181652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 306/652] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:13 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:14.205567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:14.206424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:14.214205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:14.214685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:14.215139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:14.215822 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:14.216264 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:14.216680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:14.355697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:14.367744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c72fb1ae-cf04-4569-8a5d-de05761e71e4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.168748 Aug 31 04:39:14.368315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 347/653] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:14 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:15.391151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:15.391895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:15.400383 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:15.401121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:15.401543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:15.402523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:15.403101 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:15.403624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:15.541895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:15.550635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a3a7c51b-4458-47b8-a86a-747991e438a9 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.164299 Aug 31 04:39:15.551203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 307/654] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:15 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:16.576100 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:16.577140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:16.588088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:16.588754 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:16.589319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:16.590230 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:16.590802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:16.591351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:16.736549 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:16.745254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3eef4abb-2c76-49fe-a5a9-3ab23e6daef4 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.175975 Aug 31 04:39:16.745876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 348/655] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:16 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:17.774677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:17.776307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:17.787340 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:17.788125 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:17.788848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:17.789777 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:17.790226 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:17.790643 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:17.793233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:17.923827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:17.932569 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-90d47548-aa73-4188-9182-35e59b0388d3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.164325 Aug 31 04:39:17.933110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 308/656] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:17 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:18.963677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:18.964258 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:18.970991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:18.971451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:18.971878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:18.972561 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:18.972999 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:18.973422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:19.109893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:19.118691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8e19f0e5-e6fb-414d-a37f-a94da5d5a81d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.160677 Aug 31 04:39:19.119289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 349/657] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:18 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:20.143761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:20.144570 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:20.153569 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:20.154051 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:20.154482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:20.155200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:20.155647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:20.156065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:20.301130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:20.310322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b15dcc1a-3456-4526-81a1-a9675c4b97d6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.173187 Aug 31 04:39:20.310913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 309/658] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:20 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:21.336252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:21.337212 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:21.340360 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=64 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:21.346436 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:21.346950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:21.347372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:21.348082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:21.348523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:21.348953 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:21.494947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:21.504251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-17ffe511-d161-43fa-bc4d-5f25cbaf1625 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.174571 Aug 31 04:39:21.504972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 350/659] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:21 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:22.532268 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:22.533138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:22.543882 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:22.544242 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:22.544668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:22.545359 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:22.545802 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:22.546215 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:22.688104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:22.697010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cb9ce4ef-d856-4199-b693-4506b13649ae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1736 microversion: 2.1 time: 0.171461 Aug 31 04:39:22.700469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 310/660] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:22 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:23.723571 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:23.724124 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:23.731492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:23.731972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:23.732385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:23.733069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:23.733504 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:23.733978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:23.734753 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:23.735246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:23.741482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:23.741954 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:23.742376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:23.743096 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:23.743533 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:23.743945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:23.824949 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lazy-loading 'services' on Instance uuid 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:39:23.866018 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:23.874415 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3701a3aa-34e5-4170-a096-109fa7839c33 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1716 microversion: 2.1 time: 0.154657 Aug 31 04:39:23.875002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 351/661] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:23 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:23.900002 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-52dcca14-2263-493d-9ae4-82a0300f1626 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b/os-volume_attachments/24420423-4eca-4697-9188-8613f3ac6d1f" status: 202 len: 0 microversion: 2.1 time: 0.169084 Aug 31 04:39:23.900586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 311/662] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:39:23 2022] DELETE /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b/os-volume_attachments/24420423-4eca-4697-9188-8613f3ac6d1f => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:39:23.990918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:23.991447 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:23.997766 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:23.998239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:23.998659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:23.999380 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:23.999819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:24.000229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:24.082291 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] HTTP exception thrown: Cannot 'detach_volume' instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 while it is in vm_state rescued Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Request method failure captured: Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments/3bc2d007-afc5-4e51-ac9b-7091e11f275b HTTP/1.1 Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTrfwyw_GXANrca7jvUZz8voquFELERhFjMKUTQbmsZdIr-U9Op7O8DXdpnmglE1E37_uLYT-651do0BZp05PUAmkKLgb-qOvVbhfqQ2XWXbWyged1pOKLifNivoza-T0j_wmOQW0HoQatXxOf2SCJVKKTIJtNEoaKEp4YWVOG3Yxk Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:39:24.083976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c02e60929267489cb181831f1ac578e4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c02e60929267489cb181831f1ac578e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}] Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 863e457bd6fd4bff82f552e63ca1034c Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:39:24.085579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Cannot 'detach_volume' instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 while it is in vm_state rescued Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'server_id': '543cfc4e-7580-4e55-999c-9bb37cbfca94', 'id': '3bc2d007-afc5-4e51-ac9b-7091e11f275b'} Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:39:24.086392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 while it is in vm_state rescued Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 while it is in vm_state rescued Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:24.087752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Returning 409 to user: Cannot 'detach_volume' instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 while it is in vm_state rescued {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:39:24.088711 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4284776a-445d-4844-827c-8fce834a1ff6 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments/3bc2d007-afc5-4e51-ac9b-7091e11f275b" status: 409 len: 152 microversion: 2.1 time: 0.098551 Aug 31 04:39:24.088711 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 352/663] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:39:23 2022] DELETE /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments/3bc2d007-afc5-4e51-ac9b-7091e11f275b => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 04:39:24.095451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:24.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:24.102254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:24.102753 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:24.103549 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:24.104220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:24.104665 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:24.105140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:24.175061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eb499b6d-86b4-4d80-bbe9-8237777dd44a tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "POST /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/action" status: 202 len: 0 microversion: 2.1 time: 0.083701 Aug 31 04:39:24.175681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 312/664] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:39:24 2022] POST /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:39:24.183874 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:24.184554 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:24.190683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:24.191192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:24.191624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:24.192310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:24.192792 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:24.193206 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:24.336253 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:24.344871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d272fccb-8674-47fc-ad47-97da6b8a2331 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1724 microversion: 2.1 time: 0.164915 Aug 31 04:39:24.345441 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 353/665] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:24 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:25.378436 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:25.379104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:25.388314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:25.388808 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:25.389232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:25.389938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:25.390379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:25.390818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:25.522953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:25.531659 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-998d2bc8-e2cf-4a1c-869e-e3c8a59c3040 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1724 microversion: 2.1 time: 0.159980 Aug 31 04:39:25.532204 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 313/666] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:25 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:26.107615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:26.108161 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:26.114617 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:26.115128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:26.115550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:26.116226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:26.116699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:26.117106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:26.142925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:39:26.233225 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e3f42c32-c70b-40dd-9b55-a4f86ae333fc tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 204 len: 0 microversion: 2.1 time: 0.129726 Aug 31 04:39:26.233798 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 354/667] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:39:26 2022] DELETE /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:39:26.242163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:26.242840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:26.248971 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:26.249446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:26.249874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:26.250554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:26.251048 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:26.251459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:26.385115 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:26.393523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ca352b5f-7dc8-4485-80d9-2d7fa53f15a9 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1514 microversion: 2.1 time: 0.155308 Aug 31 04:39:26.394081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 314/668] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:26 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:26.555468 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:26.556381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:26.563298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:26.563782 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:26.564203 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:26.564887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:26.565334 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:26.565752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:26.704443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:26.713241 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2d458f85-c71c-4deb-b2da-90d6ee9c417f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1724 microversion: 2.1 time: 0.163444 Aug 31 04:39:26.713805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 355/669] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:26 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:27.419974 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:27.420850 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:27.431812 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:27.432626 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:27.433306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:27.434761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:27.434985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:27.435415 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:27.570480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:27.579667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3dfa96c1-8b3d-4327-b648-365836f66a3e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1514 microversion: 2.1 time: 0.166315 Aug 31 04:39:27.580235 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 315/670] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:27 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:27.737429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:27.738058 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:27.745926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:27.746498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:27.747042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:27.748263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:27.748799 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:27.749289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:27.883041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:27.891667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-34043f1b-6dac-484f-bbb7-c9db6e58c509 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1724 microversion: 2.1 time: 0.158881 Aug 31 04:39:27.892227 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 356/671] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:27 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:28.605571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:28.606501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:28.614685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:28.615411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:28.616050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:28.617005 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:28.617650 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:28.618217 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:28.767182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:28.779096 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-304dd40d-56c8-4b89-9fcf-c2c368e0a611 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1514 microversion: 2.1 time: 0.180452 Aug 31 04:39:28.779664 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 316/672] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:28 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:28.913141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:28.913708 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:28.920456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:28.920934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:28.921361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:28.922046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:28.922515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:28.922964 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:29.062458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:29.076418 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-015dad55-7f17-40ea-9a30-3eb65d395142 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1730 microversion: 2.1 time: 0.167205 Aug 31 04:39:29.076981 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 357/673] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:28 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:29.097038 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:29.097525 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:29.104001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:29.104504 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:29.104917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:29.105587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:29.106022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:29.106425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:29.187114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-32e708fd-28be-4b7f-a1e7-ca81835bea5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093474 Aug 31 04:39:29.188057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 317/674] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:39:29 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:39:29.800195 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:29.800928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:29.807638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:29.808211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:29.808711 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:29.809477 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:29.809994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:29.810479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:29.826344 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:29.941885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:29.949738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6edfc953-0b19-4c92-9d50-5afa9816a527 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1514 microversion: 2.1 time: 0.153477 Aug 31 04:39:29.950326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 358/675] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:29 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:30.650554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-70f60135-06bf-40c2-b6fc-99c95fee582d req-9ada0a5f-1999-4640-bf0e-3a99d36c25a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b", "name": "network-vif-deleted", "tag": "5b34b2d3-f935-4783-8084-46f282724dca"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:30.662406 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-70f60135-06bf-40c2-b6fc-99c95fee582d req-9ada0a5f-1999-4640-bf0e-3a99d36c25a1 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:30.663225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-70f60135-06bf-40c2-b6fc-99c95fee582d req-9ada0a5f-1999-4640-bf0e-3a99d36c25a1 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:30.663710 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-70f60135-06bf-40c2-b6fc-99c95fee582d req-9ada0a5f-1999-4640-bf0e-3a99d36c25a1 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:30.678515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-70f60135-06bf-40c2-b6fc-99c95fee582d req-9ada0a5f-1999-4640-bf0e-3a99d36c25a1 service nova] Creating event network-vif-deleted:5b34b2d3-f935-4783-8084-46f282724dca for instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b on hv-cinder-85530 Aug 31 04:39:30.683926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-70f60135-06bf-40c2-b6fc-99c95fee582d req-9ada0a5f-1999-4640-bf0e-3a99d36c25a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038034 Aug 31 04:39:30.684638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 318/676] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:39:30.971533 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:30.972301 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:30.980025 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:30.980565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:30.980992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:30.982102 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:30.982737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:30.983175 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:31.019909 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:31.020376 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:31.020861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:31.021306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lazy-loading 'fault' on Instance uuid 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:39:31.068240 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503ba8b1d3f64186b188bed35c4baefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fbe77f79a5449b8fb2bfef82360b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:31.076136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-703f8e8d-88a0-4ecd-a6a4-57b22d7cd19e tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 200 len: 1309 microversion: 2.1 time: 0.108821 Aug 31 04:39:31.076715 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 359/677] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:30 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:32.097718 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:32.098417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] [instance: 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:32.105621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:32.106097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:32.106526 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:32.107329 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:32.107777 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:32.108193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:32.121629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] HTTP exception thrown: Instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b could not be found. Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Request method failure captured: Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b HTTP/1.1 Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuVoXsPJoSQOqdx-8q6u2bXx-CunlfY1g6ks6JK4dzHSC6zpkx_p0Jin3Wfx35biyRghJJZyghGfijy9A6U8NggChsMW510oNouGosztgAm0w90X1ZG4vd9A-UYdCJefDoiLopw7qbmkPLKByb-OZ84uoQZivbGw4ejJhihAYhadlS4 Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 52fbe77f79a5449b8fb2bfef82360b94 Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotTestJSON-556530432 Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:39:32.123410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52fbe77f79a5449b8fb2bfef82360b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_52fbe77f79a5449b8fb2bfef82360b94", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/52fbe77f79a5449b8fb2bfef82360b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/52fbe77f79a5449b8fb2bfef82360b94"}]}] Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotTestJSON-556530432 Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 52fbe77f79a5449b8fb2bfef82360b94 Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-556530432 Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotTestJSON-556530432-project Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 503ba8b1d3f64186b188bed35c4baefe Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotTestJSON-556530432-project Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b could not be found. Aug 31 04:39:32.124873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b'} Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b could not be found. Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:39:32.125743 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b could not be found. Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b could not be found. Aug 31 04:39:32.127149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:39:32.128543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] Returning 404 to user: Instance 9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:39:32.128543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dd5538ec-de20-4f9b-a7fc-37a0d0b5fd17 tempest-VolumesSnapshotTestJSON-556530432 tempest-VolumesSnapshotTestJSON-556530432-project] 10.222.0.42 "GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b" status: 404 len: 111 microversion: 2.1 time: 0.031918 Aug 31 04:39:32.128543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 319/678] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:32 2022] GET /compute/v2.1/servers/9e2dda98-f9eb-47f2-9e7b-1f0dca411d1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:39:32.711873 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-3eae599c-f1f1-449f-97ca-670725147733 req-3eadd79d-7706-488d-af58-3db1fe6c5a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543cfc4e-7580-4e55-999c-9bb37cbfca94", "tag": "1f8c2e75-3b33-4b6c-927f-d08d1ef62c56"}, {"name": "network-changed", "server_uuid": "543cfc4e-7580-4e55-999c-9bb37cbfca94", "tag": "1f8c2e75-3b33-4b6c-927f-d08d1ef62c56"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:32.724272 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-3eae599c-f1f1-449f-97ca-670725147733 req-3eadd79d-7706-488d-af58-3db1fe6c5a46 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:32.724737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-3eae599c-f1f1-449f-97ca-670725147733 req-3eadd79d-7706-488d-af58-3db1fe6c5a46 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:32.725163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-3eae599c-f1f1-449f-97ca-670725147733 req-3eadd79d-7706-488d-af58-3db1fe6c5a46 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:32.736775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-3eae599c-f1f1-449f-97ca-670725147733 req-3eadd79d-7706-488d-af58-3db1fe6c5a46 service nova] Creating event network-changed:1f8c2e75-3b33-4b6c-927f-d08d1ef62c56 for instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 on hv-cinder-85530 Aug 31 04:39:32.737276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-3eae599c-f1f1-449f-97ca-670725147733 req-3eadd79d-7706-488d-af58-3db1fe6c5a46 service nova] Creating event network-changed:1f8c2e75-3b33-4b6c-927f-d08d1ef62c56 for instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 on hv-cinder-85530 Aug 31 04:39:32.742263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-3eae599c-f1f1-449f-97ca-670725147733 req-3eadd79d-7706-488d-af58-3db1fe6c5a46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037102 Aug 31 04:39:32.742856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 360/679] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:39:37.148467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:37.152117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:37.159963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:37.160440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:37.160863 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:37.161579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:37.162020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:37.162440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:37.239133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1fbd5d91-75ef-403c-8db3-f8282109e4d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/action" status: 202 len: 0 microversion: 2.1 time: 0.097140 Aug 31 04:39:37.239750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 320/680] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:39:37 2022] POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:39:37.249905 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:37.250696 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:37.257897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:37.258614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:37.259004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:37.259924 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:37.260486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:37.261007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:37.408057 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:37.416369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6e2773bd-6497-4386-9a8c-aff57c3af9c0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1750 microversion: 2.1 time: 0.172013 Aug 31 04:39:37.416947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 361/681] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:37 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:38.053837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:38.054478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:38.068095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.068729 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.071248 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.072368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.072985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.074107 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.112638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b27bd3ea-fea7-4bbc-9051-b435cc153807 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments/3b9186ae-95bb-4563-a415-ca6969168669" status: 200 len: 194 microversion: 2.20 time: 0.063168 Aug 31 04:39:38.113543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 321/682] 10.222.0.42 () {60 vars in 1454 bytes} [Wed Aug 31 04:39:38 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments/3b9186ae-95bb-4563-a415-ca6969168669 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 04:39:38.191879 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:38.192368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:38.198384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.198893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.199356 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.200033 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.200479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.200950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.289315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lazy-loading 'services' on Instance uuid 16ba9256-6be0-49de-8c61-4454227a18c8 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:39:38.366550 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5f176ee9-8b29-4337-811d-9cdc20c5f46f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments/3b9186ae-95bb-4563-a415-ca6969168669" status: 202 len: 0 microversion: 2.20 time: 0.178619 Aug 31 04:39:38.367160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 362/683] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Aug 31 04:39:38 2022] DELETE /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments/3b9186ae-95bb-4563-a415-ca6969168669 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:39:38.375883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:38.378044 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:38.380586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=36 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:38.386513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.387022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.387454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.388238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.388773 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.389197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.422140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cd2f7fce-981c-40c1-ad4d-7b29ff0648d9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049917 Aug 31 04:39:38.422869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 322/684] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 04:39:38 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:39:38.438424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:38.439165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:38.445682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.446176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.446577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.447289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:38.447732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:38.448173 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:38.606178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:38.615152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d800bd06-e3ec-4b49-83ed-29e93291bfca tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.181281 Aug 31 04:39:38.615721 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 363/685] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:38 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:39.439117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:39.441232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:39.447803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:39.448259 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:39.448683 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:39.449368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:39.449789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:39.450232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:39.476640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:39.483010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cbdd1015-b490-4b65-b43b-7c6daafbb194 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048704 Aug 31 04:39:39.483571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 323/686] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 04:39:39 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:39:39.636685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:39.637256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:39.644205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:39.644685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:39.645142 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:39.645820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:39.646263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:39.646677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:39.790619 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:39.799538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d376cf1a-e909-4261-9d4c-9e25ddff25c5 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.166870 Aug 31 04:39:39.800095 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 364/687] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:39 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:40.495263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:40.497390 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:40.504322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.504794 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.505220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.505904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.506345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.506772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.537448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-05117864-b610-46e7-ae06-726bd19b9b0f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046530 Aug 31 04:39:40.538083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 324/688] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 04:39:40 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:40.605154 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:40.605750 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:40.619917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.620593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.621263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.622609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.624101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.624976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.655804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:39:40.739468 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c5da882b-eee8-4a1f-b3ee-c7558e040021 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 204 len: 0 microversion: 2.20 time: 0.138290 Aug 31 04:39:40.740026 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 365/689] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 04:39:40 2022] DELETE /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:39:40.748747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:40.749439 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:40.755515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.755986 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.756412 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.757092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.757532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.757943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.821918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:40.822707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:40.829620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.830137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.830806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.831564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:40.832006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:40.832476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:40.897487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:40.905994 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:40.907465 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:40.908641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a0dd86aa-0790-4883-90e9-db39d1d49b7c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.164066 Aug 31 04:39:40.909208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 325/690] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:40 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:40.980038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:40.991540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fe58b3e8-4edb-4073-9886-7b6d53e4d3e3 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.173732 Aug 31 04:39:40.992266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 366/691] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:40 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:41.938872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:41.938872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:41.944164 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:41.944664 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:41.945140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:41.945852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:41.946306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:41.946753 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:42.016243 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:42.016896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:42.023759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:42.024321 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:42.024752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:42.025481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:42.025928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:42.026316 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:42.111164 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:42.121243 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:42.124428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:42.125854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fa265891-6397-44a2-b6a2-6c57b9f47ea2 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.194825 Aug 31 04:39:42.126421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 326/692] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:41 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:42.191360 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:42.203107 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a0d3bb74-d075-4825-be23-a045c6e37c81 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.192775 Aug 31 04:39:42.203776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 367/693] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:42 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:39:43.155887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:43.156607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:43.164187 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:43.164748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:43.165253 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:43.166052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:43.166576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:43.167091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:43.229748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:43.230329 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:43.237413 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:43.237920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:43.238345 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:43.239052 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:43.239500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:43.239912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:43.305255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:43.313561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:43.315019 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:43.316163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-252c8b94-20a5-4e2d-a2a8-3b1b126f3d8c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.166446 Aug 31 04:39:43.316721 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 327/694] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:43 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:43.394259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:43.405877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-820d6e64-9ad5-46df-8b0d-d310257b8c71 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.180575 Aug 31 04:39:43.406772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 368/695] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:43 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:39:44.342965 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:44.343964 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:44.355360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:44.356145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:44.356886 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:44.357849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:44.358286 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:44.358700 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:44.429705 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:44.430311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:44.437294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:44.437773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:44.438192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:44.438914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:44.439351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:44.439742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:44.498612 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:44.507199 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:44.508623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:44.509786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-980a842d-4dc0-4143-b05f-dbba81c57c72 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.173439 Aug 31 04:39:44.510557 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 328/696] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:44 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:44.587443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:44.597532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-32d241cf-cfa9-4997-ae58-26856cc332c8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.171690 Aug 31 04:39:44.598061 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 369/697] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:44 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:45.533763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:45.534310 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:45.541214 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:45.541700 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:45.542143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:45.542859 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:45.543305 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:45.543716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:45.619363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:45.620129 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:45.627167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:45.627664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:45.628088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:45.628849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:45.629491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:45.629961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:45.759062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:45.768727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:45.770404 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:45.771756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ee97ecad-4e4e-436d-b122-4aae9ed194f3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1723 microversion: 2.20 time: 0.241950 Aug 31 04:39:45.772826 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 329/698] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:45 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:45.776434 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:45.785696 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-669c901b-47a1-4a4b-959d-c81387df2a19 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.170253 Aug 31 04:39:45.786458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 370/699] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:45 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:46.722829 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-b85bfb45-d63c-4294-9d66-4a6f8b3b8433 req-26337c95-15bf-454b-84d1-425bd9421b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ba9256-6be0-49de-8c61-4454227a18c8", "name": "network-vif-deleted", "tag": "f3809b0b-8437-4e98-88a3-a530ac0d92f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:46.735097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b85bfb45-d63c-4294-9d66-4a6f8b3b8433 req-26337c95-15bf-454b-84d1-425bd9421b79 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:46.735583 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b85bfb45-d63c-4294-9d66-4a6f8b3b8433 req-26337c95-15bf-454b-84d1-425bd9421b79 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:46.736007 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b85bfb45-d63c-4294-9d66-4a6f8b3b8433 req-26337c95-15bf-454b-84d1-425bd9421b79 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:46.748015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-b85bfb45-d63c-4294-9d66-4a6f8b3b8433 req-26337c95-15bf-454b-84d1-425bd9421b79 service nova] Creating event network-vif-deleted:f3809b0b-8437-4e98-88a3-a530ac0d92f8 for instance 16ba9256-6be0-49de-8c61-4454227a18c8 on hv-cinder-85530 Aug 31 04:39:46.753599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-b85bfb45-d63c-4294-9d66-4a6f8b3b8433 req-26337c95-15bf-454b-84d1-425bd9421b79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034821 Aug 31 04:39:46.754201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 330/700] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:39:46.795694 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:46.796279 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:46.803650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:46.804159 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:46.804972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:46.805665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:46.806109 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:46.806518 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:46.808697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:46.809482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:46.831926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:46.832576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:46.833112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:46.833939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:46.834614 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:46.835469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:46.895335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:46.904523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:46.906275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:46.907849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-df46a71c-d4a8-45a4-9c88-21d81a9c61c9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 200 len: 1367 microversion: 2.20 time: 0.115979 Aug 31 04:39:46.909045 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 371/701] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:46 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 1367 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:47.020916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:47.030768 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-49b60a57-f5e1-48a6-b544-4991db750f63 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.227086 Aug 31 04:39:47.044735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 331/702] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:46 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:47.931001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:47.931575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:47.939071 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:47.939567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:47.939970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:47.940651 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:47.941085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:47.941493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:47.956456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] HTTP exception thrown: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Request method failure captured: Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 HTTP/1.1 Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTqBrCLSgEn8W1iHUKy-E7xU9miySITfwwiiNCzzfQxRRr5sZHorJFSn0t3bhHsTAOjlXvlBA356JbuI0wNXR3oLVeVKRbwC1UYEm9Xgo5WPrmIpItSRITLmeGJKEstwXBLKP82yuy9k_tY1LI_6_oHvc9K2i02F8EBP7L-T0Q8Z8U Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:39:47.958440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bd54eb751f144b29b274e6a96dedcb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}] Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 13ac62bdb9bc4c7f94dad08f810559e9 Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:39:47.960168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '16ba9256-6be0-49de-8c61-4454227a18c8'} Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:39:47.965249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:39:47.966650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:39:47.968384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Returning 404 to user: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:39:47.968384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6bb659b2-2864-4172-b812-67ac538fb79c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 404 len: 111 microversion: 2.20 time: 0.032932 Aug 31 04:39:47.968384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 372/703] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:47 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:39:47.970963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3a410d69-a5a6-4a51-b28f-c098b1dbeef4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '.version_select at 0x7fc827118e50>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:47.994529 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3a410d69-a5a6-4a51-b28f-c098b1dbeef4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520384366" status: 204 len: 0 microversion: 2.20 time: 0.028788 Aug 31 04:39:47.995162 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 332/704] 10.222.0.42 () {60 vars in 1262 bytes} [Wed Aug 31 04:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520384366 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:39:48.051992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:48.052873 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:48.059180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:48.069282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:48.070006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:48.071881 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:48.072355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:48.072778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:48.342936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:48.347013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:48.352764 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8f875d94-622f-4cd9-8603-088861d8c078 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.304668 Aug 31 04:39:48.353313 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 373/705] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:48 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:48.776306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-907870c2-78b5-457b-81de-156cfcd016f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'create', calling method: .version_select at 0x7fc826dfb820>, body: {"keypair": {"name": "tempest-keypair-455379693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUPN2BD6wmEL9ZAJZlm7igevGiTpxKf4jE5APbLL3DhprQRTusRKg15V1PcAF2MvbX03Rqvyy08Lps6zXpk5kvEiBro8lz0UbH6o29r7Zbx+xNu3aCGOmAF10VIuRuPHQ=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:48.793513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-907870c2-78b5-457b-81de-156cfcd016f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:39:48.797678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-907870c2-78b5-457b-81de-156cfcd016f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for user 13ac62bdb9bc4c7f94dad08f810559e9 and project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:39:48.834619 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-907870c2-78b5-457b-81de-156cfcd016f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.056914 Aug 31 04:39:48.834619 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 333/706] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Aug 31 04:39:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 04:39:49.376157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:49.376763 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:49.384615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:49.385084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:49.385743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:49.386440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:49.387196 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:49.387583 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:49.730309 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:49.738793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3d6fb269-4a33-44eb-83d1-c47c9aa67be6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.367284 Aug 31 04:39:49.739586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 374/707] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:49 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:50.465768 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-839225557", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31592010-3eea-4675-990e-8bd640d060b2"}], "security_groups": [{"name": "tempest-securitygroup--321803971"}], "key_name": "tempest-keypair-455379693", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:50.741460 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] validate_networks() for [('31592010-3eea-4675-990e-8bd640d060b2', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:39:50.759952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:50.760531 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:50.767559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:50.768014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:50.768436 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:50.769120 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:50.769559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:50.769942 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:50.913326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:50.922446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a000e6ed-4907-4ab0-beae-c05a9c58fb41 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.166369 Aug 31 04:39:50.923364 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 375/708] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:50 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:51.214985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:39:51.215648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:39:51.216324 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:39:51.217006 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:39:51.217392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:39:51.226845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:51.227317 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:51.227779 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:51.228543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:51.229322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:51.229740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:51.246966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:39:51.251341 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Getting quotas for user 13ac62bdb9bc4c7f94dad08f810559e9 and project 3bd54eb751f144b29b274e6a96dedcb2. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:39:51.263433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:39:51.265877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:39:51.309970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [72f953de-c371-4e87-9c33-ad144c2fb4dc] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 04:39:51.945681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:51.946381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:51.949219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:51.956024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:51.956593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:51.957097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:51.958597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:51.959214 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:51.959712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:52.114288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:52.122871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fd97e84b-c164-4fe6-be59-a3a0d083be20 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.181796 Aug 31 04:39:52.123510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 376/709] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:51 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:52.320171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [72f953de-c371-4e87-9c33-ad144c2fb4dc] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 59566. Aug 31 04:39:52.324447 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9da4065f-36e2-46c0-8ffe-0d95fba38746 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.863076 Aug 31 04:39:52.325141 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 334/710] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 31 04:39:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 04:39:52.393526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b5d51afe-9179-4bff-a837-a012bd2564d4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:52.394305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b5d51afe-9179-4bff-a837-a012bd2564d4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:52.507401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b5d51afe-9179-4bff-a837-a012bd2564d4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:52.515381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b5d51afe-9179-4bff-a837-a012bd2564d4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:52.516907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b5d51afe-9179-4bff-a837-a012bd2564d4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:52.518114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b5d51afe-9179-4bff-a837-a012bd2564d4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1280 microversion: 2.20 time: 0.185843 Aug 31 04:39:52.518762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 377/711] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:52 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:53.145771 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:53.146377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:53.152626 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:53.153151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:53.153582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:53.154269 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:53.154758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:53.155412 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:53.385889 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:53.395501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0cd16dd3-f127-4f86-89ee-e3806640602d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.254812 Aug 31 04:39:53.396114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 335/712] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:53 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:53.543201 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:53.544542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:53.552234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:53.552711 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:53.553167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:53.553878 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:53.554296 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:53.554709 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:53.617173 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:53.626033 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:53.627753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:53.628602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-50c4496b-1aaf-4ba4-bfe8-f085438ba606 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1332 microversion: 2.20 time: 0.091726 Aug 31 04:39:53.629153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 378/713] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:53 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:54.418129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:54.418660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:54.425776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:54.426246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:54.426667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:54.427384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:54.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:54.428221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:54.656321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:54.661564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:54.662173 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:54.666620 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4ffc0f1c-6ebe-4b51-b0cb-337b5c5e7692 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.252867 Aug 31 04:39:54.667536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 336/714] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:54 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:54.672726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:54.673153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:54.673601 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:54.674361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:54.675052 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:54.675476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:54.741114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:54.749952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:54.751417 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:54.752547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-db917de9-4290-468e-8ea6-bc1cfe1e329c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1338 microversion: 2.20 time: 0.096221 Aug 31 04:39:54.753131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 379/715] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:54 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:55.534747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-0be48f33-3be0-4060-add1-3ad5cbbe68a0 req-26de8858-a2aa-48a8-83b9-e8b0a5ff5d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ff76b8-6b3d-47fc-9e88-95c76e7bd11f", "tag": "e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:39:55.544777 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0be48f33-3be0-4060-add1-3ad5cbbe68a0 req-26de8858-a2aa-48a8-83b9-e8b0a5ff5d42 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:55.545518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0be48f33-3be0-4060-add1-3ad5cbbe68a0 req-26de8858-a2aa-48a8-83b9-e8b0a5ff5d42 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:55.546087 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0be48f33-3be0-4060-add1-3ad5cbbe68a0 req-26de8858-a2aa-48a8-83b9-e8b0a5ff5d42 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:55.557423 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-0be48f33-3be0-4060-add1-3ad5cbbe68a0 req-26de8858-a2aa-48a8-83b9-e8b0a5ff5d42 service nova] Creating event network-changed:e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8 for instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f on hv-cinder-85530 Aug 31 04:39:55.563367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-0be48f33-3be0-4060-add1-3ad5cbbe68a0 req-26de8858-a2aa-48a8-83b9-e8b0a5ff5d42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031884 Aug 31 04:39:55.564468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 337/716] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:39:55.690500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:55.691135 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:55.697876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:55.698386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:55.698861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:55.699542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:55.699982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:55.700418 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:55.777869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:55.779687 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:55.789941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:55.790682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:55.791380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:55.792088 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:55.792536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:55.792977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:55.908915 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:55.920902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a11179a2-0bcf-424f-af42-22aaa6133fb8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1755 microversion: 2.1 time: 0.235253 Aug 31 04:39:55.936746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 380/717] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:55 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1755 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:55.996841 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:56.006169 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:56.008630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:56.010181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a22fd496-2768-4d51-8879-0a48a3369737 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.237620 Aug 31 04:39:56.010985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 338/718] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:55 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:56.161644 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:56.163987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:56.169936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.170543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.171047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:56.171770 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.172208 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.172607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:56.201546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2b507d59-849b-4b74-854f-6378b2a83d3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043738 Aug 31 04:39:56.202068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 381/719] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:39:56 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:39:56.265203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:56.265963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:56.272640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.273378 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.273807 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:56.274492 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.274966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.275645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:56.308582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:39:56.400344 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-50fbd8d4-5f08-432a-8e85-ceeb440f2f14 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 204 len: 0 microversion: 2.1 time: 0.139259 Aug 31 04:39:56.400941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 339/720] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:39:56 2022] DELETE /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:39:56.409319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:56.410027 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:56.445272 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.445850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.446360 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:56.449630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.450275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.450899 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:56.600423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:56.609087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-dfe16e9d-a71a-4768-b5fd-46a79d423cbd tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1672 microversion: 2.1 time: 0.203589 Aug 31 04:39:56.610061 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 382/721] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:56 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:56.944160 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:56.944883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:56.952837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.953334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.953764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:56.954495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:56.954961 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:56.955403 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:57.037909 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:57.038656 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:57.046639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:57.047409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:57.047844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:57.048543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:57.049185 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:57.049604 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:57.127550 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:57.135850 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e249e832-1f16-4ddf-a967-c4892f214782 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1758 microversion: 2.1 time: 0.196168 Aug 31 04:39:57.136420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 340/722] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:56 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:57.190368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:57.204285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:57.206669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:57.208470 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fbda4519-3531-4050-bd41-4173054525f8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.174602 Aug 31 04:39:57.209419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 383/723] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:57 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:57.636109 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:57.637140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:57.644457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:57.644935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:57.645355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:57.646038 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:57.646482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:57.646952 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:57.780310 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:57.792069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b760e98-d1d8-4980-8f12-658a0e2307c4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1672 microversion: 2.1 time: 0.162320 Aug 31 04:39:57.792921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 341/724] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:57 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:58.236611 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:58.237359 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:58.245802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:58.246402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:58.246976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:58.247877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:58.248590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:58.249589 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:58.380098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:58.388849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:58.390278 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:58.392147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0ad85840-0e1a-4b11-aeaf-f5b449ebcc19 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.161373 Aug 31 04:39:58.392741 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 384/725] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:58 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:39:58.814838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:58.815431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:58.822413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:58.822927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:58.823358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:58.824032 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:58.824470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:58.824884 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:59.140232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:59.143093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:59.150027 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c83bd43b-def5-43a4-ae4f-145b18a8bfea tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1672 microversion: 2.1 time: 0.339258 Aug 31 04:39:59.150708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 342/726] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:39:58 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1672 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:39:59.421393 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:39:59.422072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:39:59.429386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:59.429871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:59.430312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:59.431038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:39:59.431482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:39:59.431904 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:39:59.567958 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:59.576583 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:59.578059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:39:59.579458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9f8a6abb-dde5-4f3c-b18e-078ab9e03467 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.162076 Aug 31 04:39:59.580014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 385/727] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:39:59 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:00.092363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-ceccc86b-0368-4b6c-88b7-01bfb9a5d0f5 req-ea9f8a0a-b2e9-41d8-b457-1f13c2a5c7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d80f26-ed89-466a-8716-08e48aa7dfb8", "name": "network-vif-deleted", "tag": "53ccda52-6f23-4095-832d-ffc497d77603"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:00.103619 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ceccc86b-0368-4b6c-88b7-01bfb9a5d0f5 req-ea9f8a0a-b2e9-41d8-b457-1f13c2a5c7fb service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:00.104071 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ceccc86b-0368-4b6c-88b7-01bfb9a5d0f5 req-ea9f8a0a-b2e9-41d8-b457-1f13c2a5c7fb service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:00.104873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-ceccc86b-0368-4b6c-88b7-01bfb9a5d0f5 req-ea9f8a0a-b2e9-41d8-b457-1f13c2a5c7fb service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:00.116642 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-ceccc86b-0368-4b6c-88b7-01bfb9a5d0f5 req-ea9f8a0a-b2e9-41d8-b457-1f13c2a5c7fb service nova] Creating event network-vif-deleted:53ccda52-6f23-4095-832d-ffc497d77603 for instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 on hv-cinder-85530 Aug 31 04:40:00.121577 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-ceccc86b-0368-4b6c-88b7-01bfb9a5d0f5 req-ea9f8a0a-b2e9-41d8-b457-1f13c2a5c7fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033864 Aug 31 04:40:00.122220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 343/728] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:00.171537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:00.172437 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:00.178710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:00.179338 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:00.179856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:00.180605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:00.181103 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:00.181697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:00.249946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:00.258570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c4dfd2ed-3a8f-4957-8a38-9b04506ba160 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1605 microversion: 2.1 time: 0.091063 Aug 31 04:40:00.259422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 386/729] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:00 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1605 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:00.602494 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:00.603203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:00.611576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:00.612071 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:00.612680 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:00.613397 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:00.613839 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:00.614250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:00.760283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:00.769198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:00.770658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:00.771804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0820050e-395a-4ba5-a7e0-a2ad0c7b85d7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.173877 Aug 31 04:40:00.772552 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 344/730] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:00 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:01.279970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:01.280560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:01.287518 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:01.288065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:01.288542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:01.289348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:01.290017 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:01.290503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:01.324648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:01.325186 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:01.325681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:01.326142 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lazy-loading 'fault' on Instance uuid 37d80f26-ed89-466a-8716-08e48aa7dfb8 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:40:01.368249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:01.377562 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6c137c3f-df01-4a23-8b87-6e4bcee3ebaa tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 200 len: 1327 microversion: 2.1 time: 0.101334 Aug 31 04:40:01.378256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 387/731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:01 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:01.794906 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:01.795488 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:01.798271 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:01.799073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=10 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:01.805633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:01.806111 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:01.806543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:01.807279 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:01.807729 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:01.808150 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:01.939144 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:01.947530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:01.948928 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:01.950028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b0245ccf-2484-451d-b5f8-03bfbc90da3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.159157 Aug 31 04:40:01.950591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 345/732] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:01 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:02.400690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:02.401257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:02.408748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:02.409261 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:02.409677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:02.410357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:02.410852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:02.411246 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:02.424709 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] HTTP exception thrown: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Request method failure captured: Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 HTTP/1.1 Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTtCMmQD-tV0wzwcagU0VgHu5uLpWfLkeBFOT9yaL97mfDFUIASWen32QeUE-o19IuOe8vt9s5j_bEbcJW9MsTraI_t2SyZTx9O7CDUNm10-O1cRQACk6F8klq9n5p7HKeP9pxWE4kdBVxmbe8odMLrbuQ308NrfmGbsJDEHIdJS3Q Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:40:02.426220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94afda48b8e545dfaeac33a66f592fe2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}] Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 718418f954f94dad93eeb725e345c850 Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:40:02.427825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '37d80f26-ed89-466a-8716-08e48aa7dfb8'} Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:40:02.428716 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:40:02.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:02.431319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Returning 404 to user: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:40:02.431319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b99afa4c-70c6-4f79-907e-1d1f96730b34 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 404 len: 111 microversion: 2.1 time: 0.030972 Aug 31 04:40:02.431319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 388/733] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:02 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:40:02.436584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a3332c8e-72c7-4fb4-abb8-5fd071d5a43e tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '.version_select at 0x7fc826f440d0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:02.458191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a3332c8e-72c7-4fb4-abb8-5fd071d5a43e tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143802921" status: 202 len: 0 microversion: 2.1 time: 0.025428 Aug 31 04:40:02.458793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 346/734] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 31 04:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143802921 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:40:02.972863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:02.973457 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:02.975326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:02.981547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:02.982014 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:02.982426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:02.983136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:02.983565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:02.983973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:03.120530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:03.125561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-11b85f69-3f7e-4bb7-b454-614f244b9515 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'create', calling method: .version_select at 0x7fc826e05820>, body: {"keypair": {"name": "tempest-keypair-428226973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTumJO+sX5bdQgYjfIbuhLKOPtYUkY52nZWSut9zC+nx9XlAEtOBWoK7ysfo9BQB8kfOgViX3IW6Ylf555bjN4v3dYvsiw5p5aR/jrXsTI1bD163K6lJjqaJaqlT2q0ZQ=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:03.129141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:03.130564 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:03.131725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-757f1a98-767f-495f-853d-8f07fdbeee33 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.162956 Aug 31 04:40:03.132413 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 389/735] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:02 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:40:03.147423 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-11b85f69-3f7e-4bb7-b454-614f244b9515 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:40:03.151354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-11b85f69-3f7e-4bb7-b454-614f244b9515 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for user 718418f954f94dad93eeb725e345c850 and project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:40:03.175178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-11b85f69-3f7e-4bb7-b454-614f244b9515 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054032 Aug 31 04:40:03.175775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 347/736] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:40:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:40:03.755961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-07e67994-4565-420f-9ddd-c5336b9c95f5 req-889665ad-f121-4ed3-9d1a-06e23b90e5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff76b8-6b3d-47fc-9e88-95c76e7bd11f", "name": "network-vif-plugged", "status": "completed", "tag": "e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:03.767442 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-07e67994-4565-420f-9ddd-c5336b9c95f5 req-889665ad-f121-4ed3-9d1a-06e23b90e5e4 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:03.767995 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-07e67994-4565-420f-9ddd-c5336b9c95f5 req-889665ad-f121-4ed3-9d1a-06e23b90e5e4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:03.768600 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-07e67994-4565-420f-9ddd-c5336b9c95f5 req-889665ad-f121-4ed3-9d1a-06e23b90e5e4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:03.780152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-07e67994-4565-420f-9ddd-c5336b9c95f5 req-889665ad-f121-4ed3-9d1a-06e23b90e5e4 service nova] Creating event network-vif-plugged:e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8 for instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f on hv-cinder-85530 Aug 31 04:40:03.785217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-07e67994-4565-420f-9ddd-c5336b9c95f5 req-889665ad-f121-4ed3-9d1a-06e23b90e5e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Aug 31 04:40:03.785794 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 390/737] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:04.154151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:04.154869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:04.161092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:04.161570 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:04.161999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:04.162738 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:04.163246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:04.163668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:04.401314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:04.411534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:04.413015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:04.414133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-78954a8f-1cef-4f55-9127-6fecce86f337 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.264481 Aug 31 04:40:04.414685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 348/738] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:04 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:04.669119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1141640379", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4d0d7af-fefb-4895-aa58-44d019a740ec"}], "security_groups": [{"name": "tempest-securitygroup--1919903641"}], "key_name": "tempest-keypair-428226973", "user_data": "}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:04.780262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] validate_networks() for [('e4d0d7af-fefb-4895-aa58-44d019a740ec', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:40:05.223673 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:40:05.224290 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:40:05.224980 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:40:05.225573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:40:05.226170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:40:05.239271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:05.239750 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:05.240180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:05.240937 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:05.241386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:05.241806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:05.259081 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:40:05.263198 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Getting quotas for user 718418f954f94dad93eeb725e345c850 and project 94afda48b8e545dfaeac33a66f592fe2. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:40:05.275734 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:40:05.278137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:40:05.333034 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-02220b4b-97d3-4910-a016-972fea9e5b00 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.668512 Aug 31 04:40:05.333690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 391/739] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:40:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:40:05.344621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3a286b31-f731-40df-bbed-0cfcf3c2dbd5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:05.345221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3a286b31-f731-40df-bbed-0cfcf3c2dbd5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:05.348242 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:05.403675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3a286b31-f731-40df-bbed-0cfcf3c2dbd5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:05.410857 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3a286b31-f731-40df-bbed-0cfcf3c2dbd5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1237 microversion: 2.1 time: 0.070182 Aug 31 04:40:05.411508 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 349/740] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:05 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:05.439487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:05.440087 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:05.448660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:05.449254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:05.449738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:05.450464 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:05.450943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:05.451395 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:05.596061 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:05.604420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:05.606428 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:05.607656 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cfa19093-2d6c-4217-9013-7d4902efd07a tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1405 microversion: 2.20 time: 0.174337 Aug 31 04:40:05.608549 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 392/741] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:05 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:06.431747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:06.432355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:06.439991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:06.440467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:06.440897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:06.441581 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:06.442027 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:06.442445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:06.506030 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:06.513730 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dc5dca95-efd5-435b-9d88-db59c3a5c61a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1289 microversion: 2.1 time: 0.085934 Aug 31 04:40:06.514297 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 350/742] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:06 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:06.635363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:06.636354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:06.645141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:06.645617 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:06.646034 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:06.646710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:06.647198 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:06.647592 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:06.650211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:06.790812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:06.799475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:06.801040 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:06.802393 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-00ad044f-4d1f-43f5-94a9-519e0e93ed3d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1598 microversion: 2.20 time: 0.173901 Aug 31 04:40:06.803037 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 393/743] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:06 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:06.824458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:06.824949 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:06.831645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:06.832368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:06.832941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:06.833794 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:06.834392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:06.834982 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:06.953182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0cd47852-f91b-417c-bf61-f354c0c09098 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.132717 Aug 31 04:40:06.954434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 351/744] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 31 04:40:06 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:40:07.534951 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:07.535509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:07.541977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:07.542456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:07.542921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:07.543621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:07.544090 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:07.544487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:07.618471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:07.627054 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0e5c2679-9b4e-477f-bbb6-aac64c891ecb tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1295 microversion: 2.1 time: 0.096050 Aug 31 04:40:07.628137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 394/745] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:07 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:08.166402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-86a334f9-7291-472d-9df1-52537706b82d req-896958cb-4129-4c8d-87a0-dea4bc3b4547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ff76b8-6b3d-47fc-9e88-95c76e7bd11f", "tag": "e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:08.176819 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-86a334f9-7291-472d-9df1-52537706b82d req-896958cb-4129-4c8d-87a0-dea4bc3b4547 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:08.177635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-86a334f9-7291-472d-9df1-52537706b82d req-896958cb-4129-4c8d-87a0-dea4bc3b4547 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:08.178222 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-86a334f9-7291-472d-9df1-52537706b82d req-896958cb-4129-4c8d-87a0-dea4bc3b4547 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:08.189766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-86a334f9-7291-472d-9df1-52537706b82d req-896958cb-4129-4c8d-87a0-dea4bc3b4547 service nova] Creating event network-changed:e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8 for instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f on hv-cinder-85530 Aug 31 04:40:08.194821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-86a334f9-7291-472d-9df1-52537706b82d req-896958cb-4129-4c8d-87a0-dea4bc3b4547 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033177 Aug 31 04:40:08.195516 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 352/746] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:08.648596 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:08.649486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:08.658557 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:08.659326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:08.659925 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:08.660622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:08.661220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:08.661957 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:08.752085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-71347eb2-fe0c-4632-aed7-75af8acaba29 req-02f78195-c03b-4454-9903-a9726f1f4f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9472a4bc-d255-45a5-a6b0-016a1bd62606", "tag": "e93ec718-bb93-4cf8-88f6-b2a75cf59395"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:08.762662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-71347eb2-fe0c-4632-aed7-75af8acaba29 req-02f78195-c03b-4454-9903-a9726f1f4f91 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:08.763298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-71347eb2-fe0c-4632-aed7-75af8acaba29 req-02f78195-c03b-4454-9903-a9726f1f4f91 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:08.763848 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-71347eb2-fe0c-4632-aed7-75af8acaba29 req-02f78195-c03b-4454-9903-a9726f1f4f91 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:08.775971 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-71347eb2-fe0c-4632-aed7-75af8acaba29 req-02f78195-c03b-4454-9903-a9726f1f4f91 service nova] Creating event network-changed:e93ec718-bb93-4cf8-88f6-b2a75cf59395 for instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 on hv-cinder-85530 Aug 31 04:40:08.781119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-71347eb2-fe0c-4632-aed7-75af8acaba29 req-02f78195-c03b-4454-9903-a9726f1f4f91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225546 Aug 31 04:40:08.781846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 395/747] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:08.787645 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:08.788335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:08.797269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:08.797992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:08.798660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:08.799671 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:08.800250 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:08.800802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:08.893887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lazy-loading 'services' on Instance uuid 543cfc4e-7580-4e55-999c-9bb37cbfca94 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:40:08.979535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6fac72ed-6ef4-4426-9f4d-f46811a80348 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments/3bc2d007-afc5-4e51-ac9b-7091e11f275b" status: 202 len: 0 microversion: 2.1 time: 0.195868 Aug 31 04:40:08.980764 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 396/748] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:40:08 2022] DELETE /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments/3bc2d007-afc5-4e51-ac9b-7091e11f275b => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:40:08.990337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:08.993183 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:09.000167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:09.001496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:09.002354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:09.003429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:09.004078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:09.004683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:09.019893 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:09.039964 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e6b3fbdf-0b6f-4634-b8f3-d207b1b11a3d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1363 microversion: 2.1 time: 0.395723 Aug 31 04:40:09.045162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b9349519-ed9a-44a1-bf45-489597697aaa tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059321 Aug 31 04:40:09.046023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 397/749] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:40:08 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:09.054591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 353/750] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:08 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:40:10.062835 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:10.065108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:10.065505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:10.065791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:10.073164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:10.073164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:10.073509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:10.073865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:10.074207 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:10.074349 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:10.074648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:10.074833 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:10.075105 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:10.075454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:10.075895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:10.076309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:10.106899 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-00fb0df2-164c-4314-ac1a-a2220f33b96c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051478 Aug 31 04:40:10.107460 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 398/751] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:40:10 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:10.208266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:10.216980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0da09ac5-59c9-4d33-9672-3ac6372ca11b tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1363 microversion: 2.1 time: 0.157953 Aug 31 04:40:10.217791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 354/752] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:10 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:11.120073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:11.122456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:11.129342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.129842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.130269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.131001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.131442 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.132006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.165162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9e5935bc-3174-49e7-8524-ff1859011799 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048671 Aug 31 04:40:11.169974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 399/753] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:40:11 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:40:11.237540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:11.238341 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:11.243706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:11.243960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:11.248028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.248554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.248943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.249617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.249933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.250089 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.250465 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.250605 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.251287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.252242 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.252676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.253084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.279925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:40:11.392450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cedec455-c1df-4a86-ba6a-836d193e627f tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 204 len: 0 microversion: 2.1 time: 0.152406 Aug 31 04:40:11.397513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 400/754] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:40:11 2022] DELETE /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:40:11.403758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:11.404645 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:11.412744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.413048 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.413701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.414444 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:11.415018 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:11.415503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:11.554340 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:11.563161 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5f0d0504-8152-404b-8120-e77afc9543af tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1690 microversion: 2.1 time: 0.163581 Aug 31 04:40:11.563710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 401/755] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:11 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:11.667764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:11.679847 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5ab65561-4fd5-4ed7-a782-9f6dcdaf97f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1363 microversion: 2.1 time: 0.445909 Aug 31 04:40:11.680655 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 355/756] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:11 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:12.588768 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:12.589691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:12.600819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:12.601662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:12.602376 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:12.603585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:12.604327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:12.605428 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:12.704403 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:12.705128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:12.712206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:12.712692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:12.713114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:12.713786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:12.714225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:12.714638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:12.751680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:12.759612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-701cc351-6945-401c-943f-1aff94de19e3 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1690 microversion: 2.1 time: 0.177332 Aug 31 04:40:12.760163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 402/757] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:12 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:12.869818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:12.878484 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-13949c09-d9af-47aa-8d5f-8a6262154158 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1363 microversion: 2.1 time: 0.178352 Aug 31 04:40:12.879092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 356/758] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:12 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:13.780883 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:13.781503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:13.788050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:13.788553 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:13.788970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:13.789654 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:13.790098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:13.790506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:13.899871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:13.900456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:13.907326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:13.907793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:13.908421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:13.909337 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:13.909785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:13.910378 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:13.923880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:13.931653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-172b4963-e8f2-4b47-b38d-da4e01dd9dae tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1690 microversion: 2.1 time: 0.154742 Aug 31 04:40:13.932231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 403/759] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:13 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:14.042950 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:14.051005 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2cca8e7a-ef7b-4ebb-ba10-f6a26c7902f5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1363 microversion: 2.1 time: 0.155040 Aug 31 04:40:14.051543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 357/760] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:13 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:14.956301 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:14.956985 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:14.965275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:14.965748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:14.966168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:14.966904 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:14.967354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:14.967761 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:15.078614 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:15.079887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:15.089983 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:15.090746 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:15.091397 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:15.092444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:15.093127 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:15.093764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:15.113881 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:15.122244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fc70df29-1629-45b4-83bb-9f8e5bea7b75 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1690 microversion: 2.1 time: 0.171918 Aug 31 04:40:15.122845 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 404/761] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:14 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:40:15.317466 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:15.325469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9bef4877-ad7c-4980-b09f-7a06fd1618f8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1363 microversion: 2.1 time: 0.254977 Aug 31 04:40:15.326042 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 358/762] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:15 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:15.805373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-7c162942-734a-450b-95d9-602735bf1fdd req-ce06df1e-ff0f-49d2-9024-9ee2e15b9287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9472a4bc-d255-45a5-a6b0-016a1bd62606", "name": "network-vif-plugged", "status": "completed", "tag": "e93ec718-bb93-4cf8-88f6-b2a75cf59395"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:15.812125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:15.813131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=6 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:15.823060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7c162942-734a-450b-95d9-602735bf1fdd req-ce06df1e-ff0f-49d2-9024-9ee2e15b9287 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:15.823634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7c162942-734a-450b-95d9-602735bf1fdd req-ce06df1e-ff0f-49d2-9024-9ee2e15b9287 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:15.824128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7c162942-734a-450b-95d9-602735bf1fdd req-ce06df1e-ff0f-49d2-9024-9ee2e15b9287 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:15.836494 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-7c162942-734a-450b-95d9-602735bf1fdd req-ce06df1e-ff0f-49d2-9024-9ee2e15b9287 service nova] Creating event network-vif-plugged:e93ec718-bb93-4cf8-88f6-b2a75cf59395 for instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 on hv-cinder-85530 Aug 31 04:40:15.842059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-7c162942-734a-450b-95d9-602735bf1fdd req-ce06df1e-ff0f-49d2-9024-9ee2e15b9287 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040625 Aug 31 04:40:15.842797 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 405/763] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:16.076274 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-be701d3f-d407-4dd2-9899-d8339350c286 req-ea380013-3ff8-42a7-ae1b-f74b0e4ea5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543cfc4e-7580-4e55-999c-9bb37cbfca94", "name": "network-vif-deleted", "tag": "1f8c2e75-3b33-4b6c-927f-d08d1ef62c56"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:16.083267 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:16.089726 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-be701d3f-d407-4dd2-9899-d8339350c286 req-ea380013-3ff8-42a7-ae1b-f74b0e4ea5a4 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:16.090196 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-be701d3f-d407-4dd2-9899-d8339350c286 req-ea380013-3ff8-42a7-ae1b-f74b0e4ea5a4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:16.090848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-be701d3f-d407-4dd2-9899-d8339350c286 req-ea380013-3ff8-42a7-ae1b-f74b0e4ea5a4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:16.110398 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-be701d3f-d407-4dd2-9899-d8339350c286 req-ea380013-3ff8-42a7-ae1b-f74b0e4ea5a4 service nova] Creating event network-vif-deleted:1f8c2e75-3b33-4b6c-927f-d08d1ef62c56 for instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 on hv-cinder-85530 Aug 31 04:40:16.115610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-be701d3f-d407-4dd2-9899-d8339350c286 req-ea380013-3ff8-42a7-ae1b-f74b0e4ea5a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043194 Aug 31 04:40:16.116758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 359/764] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:16.154372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:16.156115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:16.165557 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:16.166350 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:16.167033 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:16.167976 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:16.168733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:16.169657 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:16.249355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:16.258056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-df3cff3f-0506-48ee-b27e-eddd3a065640 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1331 microversion: 2.1 time: 0.117140 Aug 31 04:40:16.258852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 406/765] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:16 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:40:16.346687 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:16.347507 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:16.354114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:16.354750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:16.355545 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:16.356243 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:16.356693 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:16.357108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:16.515216 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:16.523664 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3e79f5b6-5914-4866-9db9-ba03e978c10a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1363 microversion: 2.1 time: 0.181388 Aug 31 04:40:16.524208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 360/766] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:16 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:17.279609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:17.280215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:17.287286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:17.287702 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:17.288127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:17.288809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:17.289255 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:17.289667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:17.322424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:17.323042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:17.323366 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:17.323812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lazy-loading 'fault' on Instance uuid 543cfc4e-7580-4e55-999c-9bb37cbfca94 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:40:17.367117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:17.375072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-872399ca-2984-4aa8-a180-bfae08931dda tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 200 len: 1336 microversion: 2.1 time: 0.099427 Aug 31 04:40:17.375640 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 407/767] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:17 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:17.548828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:17.549974 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:17.560819 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:17.561618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:17.562350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:17.563517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:17.564371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:17.564940 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:17.700806 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:17.709092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4868a8a6-cea6-4590-85e4-3d2e4599280c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1549 microversion: 2.1 time: 0.167009 Aug 31 04:40:17.709660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 361/768] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:17 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:17.733410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:17.734216 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:17.741713 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:17.742729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:17.743432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:17.744317 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:17.744768 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:17.745187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:17.759400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:17.825608 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e5176d58-dbcd-4413-a38f-4d1a8aafd67a tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098943 Aug 31 04:40:17.826249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 408/769] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:40:17 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:40:18.396091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:18.396698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: 543cfc4e-7580-4e55-999c-9bb37cbfca94] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:18.402865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:18.403341 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:18.403764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:18.405103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:18.405574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:18.405996 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:18.421176 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] HTTP exception thrown: Instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 could not be found. Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Request method failure captured: Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 HTTP/1.1 Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTrfwyw_GXANrca7jvUZz8voquFELERhFjMKUTQbmsZdIr-U9Op7O8DXdpnmglE1E37_uLYT-651do0BZp05PUAmkKLgb-qOvVbhfqQ2XWXbWyged1pOKLifNivoza-T0j_wmOQW0HoQatXxOf2SCJVKKTIJtNEoaKEp4YWVOG3Yxk Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:40:18.424236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c02e60929267489cb181831f1ac578e4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c02e60929267489cb181831f1ac578e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}] Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 863e457bd6fd4bff82f552e63ca1034c Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 could not be found. Aug 31 04:40:18.425905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '543cfc4e-7580-4e55-999c-9bb37cbfca94'} Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 could not be found. Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:40:18.426855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 could not be found. Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 could not be found. Aug 31 04:40:18.428250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:18.429443 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Returning 404 to user: Instance 543cfc4e-7580-4e55-999c-9bb37cbfca94 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:40:18.429443 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-63b1814f-6a65-4ba6-a81a-b52385f7bc45 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94" status: 404 len: 111 microversion: 2.1 time: 0.033852 Aug 31 04:40:18.429443 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 362/770] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:18 2022] GET /compute/v2.1/servers/543cfc4e-7580-4e55-999c-9bb37cbfca94 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:40:18.435337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-510bdf68-6aed-436d-8861-62292db2f8e8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '.version_select at 0x7fc826fceca0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:18.459586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-510bdf68-6aed-436d-8861-62292db2f8e8 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906299075" status: 202 len: 0 microversion: 2.1 time: 0.028709 Aug 31 04:40:18.460149 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 409/771] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 31 04:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906299075 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:40:18.803939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-07744ecb-74cc-40dd-a5d3-6bb8e971abd3 req-18a2646d-147a-4a63-b8e8-702e9633b444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9472a4bc-d255-45a5-a6b0-016a1bd62606", "tag": "e93ec718-bb93-4cf8-88f6-b2a75cf59395"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:18.814678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-07744ecb-74cc-40dd-a5d3-6bb8e971abd3 req-18a2646d-147a-4a63-b8e8-702e9633b444 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:18.815423 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-07744ecb-74cc-40dd-a5d3-6bb8e971abd3 req-18a2646d-147a-4a63-b8e8-702e9633b444 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:18.816191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-07744ecb-74cc-40dd-a5d3-6bb8e971abd3 req-18a2646d-147a-4a63-b8e8-702e9633b444 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:18.827722 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-07744ecb-74cc-40dd-a5d3-6bb8e971abd3 req-18a2646d-147a-4a63-b8e8-702e9633b444 service nova] Creating event network-changed:e93ec718-bb93-4cf8-88f6-b2a75cf59395 for instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 on hv-cinder-85530 Aug 31 04:40:18.833255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-07744ecb-74cc-40dd-a5d3-6bb8e971abd3 req-18a2646d-147a-4a63-b8e8-702e9633b444 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032967 Aug 31 04:40:18.834207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 363/772] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:21.388940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:21.389461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:21.396645 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:21.397128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:21.397576 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:21.398496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:21.398994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:21.399417 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:21.424354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:40:21.490663 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:21.513074 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d5d8996a-c394-4360-bf5a-2ee5d6769601 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 204 len: 0 microversion: 2.1 time: 0.128405 Aug 31 04:40:21.513881 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 410/773] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:40:21 2022] DELETE /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:40:21.523180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:21.523885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:21.530418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:21.530930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:21.531364 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:21.532068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:21.532518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:21.532943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:21.670522 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:21.678663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5efcb861-a4ef-4d8a-b206-71092ccd2e6c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1509 microversion: 2.1 time: 0.160476 Aug 31 04:40:21.679610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 364/774] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:21 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:22.705991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:22.707298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:22.718211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:22.719068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:22.719781 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:22.720909 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:22.721647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:22.722342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:22.867714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:22.875949 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b3be4414-4367-4e41-b0f3-159936bb6036 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1509 microversion: 2.1 time: 0.177352 Aug 31 04:40:22.876524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 411/775] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:22 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:23.897050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:23.897646 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:23.905287 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:23.905760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:23.906188 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:23.906906 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:23.907355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:23.907821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:24.055630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:24.064409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5a91cacb-d36a-4dd9-b5ce-ecd2fdec5a58 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1509 microversion: 2.1 time: 0.171224 Aug 31 04:40:24.065208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 365/776] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:23 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:24.758918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-6e25bbf6-5c47-4af7-bbf1-d63e50721bac req-ee27ab89-312f-474a-a56d-cbf9c4e117b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43", "name": "network-vif-deleted", "tag": "c124b064-1e1f-4174-96ce-6515e6731abc"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:24.769314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-6e25bbf6-5c47-4af7-bbf1-d63e50721bac req-ee27ab89-312f-474a-a56d-cbf9c4e117b4 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:24.769764 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-6e25bbf6-5c47-4af7-bbf1-d63e50721bac req-ee27ab89-312f-474a-a56d-cbf9c4e117b4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:24.770197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-6e25bbf6-5c47-4af7-bbf1-d63e50721bac req-ee27ab89-312f-474a-a56d-cbf9c4e117b4 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:24.781585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-6e25bbf6-5c47-4af7-bbf1-d63e50721bac req-ee27ab89-312f-474a-a56d-cbf9c4e117b4 service nova] Creating event network-vif-deleted:c124b064-1e1f-4174-96ce-6515e6731abc for instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 on hv-cinder-85530 Aug 31 04:40:24.786585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-6e25bbf6-5c47-4af7-bbf1-d63e50721bac req-ee27ab89-312f-474a-a56d-cbf9c4e117b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031680 Aug 31 04:40:24.787431 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 412/777] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:25.085913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:25.086514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:25.093697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:25.094183 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:25.094617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:25.095358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:25.095785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:25.096198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:25.099055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:25.135112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:25.135587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:25.136010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:25.136453 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lazy-loading 'fault' on Instance uuid bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:40:25.179086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:25.187326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5883570f-3348-47b0-83e0-d3e1be0a4e86 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 200 len: 1312 microversion: 2.1 time: 0.105488 Aug 31 04:40:25.187889 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 366/778] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:25 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:26.214121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:26.214791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:26.221614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:26.222083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:26.222500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:26.223213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:26.223648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:26.224056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:26.238237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] HTTP exception thrown: Instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 could not be found. Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Request method failure captured: Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 HTTP/1.1 Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTrfwyw_GXANrca7jvUZz8voquFELERhFjMKUTQbmsZdIr-U9Op7O8DXdpnmglE1E37_uLYT-651do0BZp05PUAmkKLgb-qOvVbhfqQ2XWXbWyged1pOKLifNivoza-T0j_wmOQW0HoQatXxOf2SCJVKKTIJtNEoaKEp4YWVOG3Yxk Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:40:26.239887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c02e60929267489cb181831f1ac578e4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c02e60929267489cb181831f1ac578e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}] Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 863e457bd6fd4bff82f552e63ca1034c Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 could not be found. Aug 31 04:40:26.241266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': 'bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43'} Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 could not be found. Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:40:26.242073 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 could not be found. Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 could not be found. Aug 31 04:40:26.243575 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:26.244992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Returning 404 to user: Instance bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:40:26.244992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-aead4091-5ff7-4cf0-ab15-ccd22aa5469d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43" status: 404 len: 111 microversion: 2.1 time: 0.033417 Aug 31 04:40:26.244992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 413/779] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:26 2022] GET /compute/v2.1/servers/bc9d56c9-aa9d-4907-b6e0-e6cecabb2c43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:40:26.250026 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:26.250572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:26.258108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:26.258593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:26.259055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:26.259740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:26.260186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:26.260601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:26.286888 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:40:26.365057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cea02046-13db-4cdf-bfd1-503339557e2b tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 204 len: 0 microversion: 2.1 time: 0.118560 Aug 31 04:40:26.365697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 367/780] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:40:26 2022] DELETE /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:40:26.373781 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:26.374479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:26.380936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:26.381420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:26.381852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:26.383305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:26.383759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:26.384188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:26.541247 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:26.549894 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-95b3683f-075a-4461-aa1a-58eaf0c07a34 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.179940 Aug 31 04:40:26.550456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 414/781] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:26 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:40:27.575962 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:27.577107 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:27.587725 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:27.588205 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:27.588629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:27.589306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:27.589748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:27.590161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:27.737107 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:27.745544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c8d7262f-4464-436e-bb31-aac33202996c tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.176656 Aug 31 04:40:27.746113 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 368/782] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:27 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:28.770678 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:28.771467 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:28.781931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:28.782767 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:28.783423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:28.784451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:28.785134 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:28.785765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:28.932349 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:28.940233 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1111969c-bc6e-48bb-9259-fd49105b6b5e tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.176074 Aug 31 04:40:28.940794 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 415/783] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:28 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:29.961167 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:29.961843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:29.968698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:29.969174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:29.969599 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:29.970282 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:29.970737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:29.971153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:30.163773 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863e457bd6fd4bff82f552e63ca1034c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02e60929267489cb181831f1ac578e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:30.172726 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7ec2a2d9-49ba-414e-b112-652d9e7f955d tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 200 len: 1522 microversion: 2.1 time: 0.215254 Aug 31 04:40:30.173330 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 369/784] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:29 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:30.251579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-bd82f86c-8609-4bfb-a2a9-5c185c99b90b req-0fe3fe70-e070-47b9-9b2c-23f19b39ad5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaed2599-c3cc-4ac7-91be-29c314bf23cb", "name": "network-vif-deleted", "tag": "d3c77a9f-10ad-42fc-ba35-41e7e28b3832"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:30.263987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-bd82f86c-8609-4bfb-a2a9-5c185c99b90b req-0fe3fe70-e070-47b9-9b2c-23f19b39ad5b service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:30.264649 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-bd82f86c-8609-4bfb-a2a9-5c185c99b90b req-0fe3fe70-e070-47b9-9b2c-23f19b39ad5b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:30.265068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-bd82f86c-8609-4bfb-a2a9-5c185c99b90b req-0fe3fe70-e070-47b9-9b2c-23f19b39ad5b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:30.278809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-bd82f86c-8609-4bfb-a2a9-5c185c99b90b req-0fe3fe70-e070-47b9-9b2c-23f19b39ad5b service nova] Creating event network-vif-deleted:d3c77a9f-10ad-42fc-ba35-41e7e28b3832 for instance aaed2599-c3cc-4ac7-91be-29c314bf23cb on hv-cinder-85530 Aug 31 04:40:30.284110 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-bd82f86c-8609-4bfb-a2a9-5c185c99b90b req-0fe3fe70-e070-47b9-9b2c-23f19b39ad5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036194 Aug 31 04:40:30.285075 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 416/785] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:31.199431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:31.200284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] [instance: aaed2599-c3cc-4ac7-91be-29c314bf23cb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:31.211131 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:31.211902 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:31.212641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:31.213587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:31.214037 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:31.214452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:31.227985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] HTTP exception thrown: Instance aaed2599-c3cc-4ac7-91be-29c314bf23cb could not be found. Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Request method failure captured: Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb HTTP/1.1 Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTrfwyw_GXANrca7jvUZz8voquFELERhFjMKUTQbmsZdIr-U9Op7O8DXdpnmglE1E37_uLYT-651do0BZp05PUAmkKLgb-qOvVbhfqQ2XWXbWyged1pOKLifNivoza-T0j_wmOQW0HoQatXxOf2SCJVKKTIJtNEoaKEp4YWVOG3Yxk Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:40:31.229648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c02e60929267489cb181831f1ac578e4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c02e60929267489cb181831f1ac578e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c02e60929267489cb181831f1ac578e4"}]}] Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c02e60929267489cb181831f1ac578e4 Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-375130138 Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 863e457bd6fd4bff82f552e63ca1034c Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-375130138-project Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance aaed2599-c3cc-4ac7-91be-29c314bf23cb could not be found. Aug 31 04:40:31.231579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': 'aaed2599-c3cc-4ac7-91be-29c314bf23cb'} Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaed2599-c3cc-4ac7-91be-29c314bf23cb could not be found. Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:40:31.232389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaed2599-c3cc-4ac7-91be-29c314bf23cb could not be found. Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaed2599-c3cc-4ac7-91be-29c314bf23cb could not be found. Aug 31 04:40:31.233838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:31.235201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] Returning 404 to user: Instance aaed2599-c3cc-4ac7-91be-29c314bf23cb could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:40:31.235201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6dd30b2c-6ff8-4d8d-b4ec-b2f2aea3b958 tempest-ServerRescueNegativeTestJSON-375130138 tempest-ServerRescueNegativeTestJSON-375130138-project] 10.222.0.42 "GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb" status: 404 len: 111 microversion: 2.1 time: 0.039043 Aug 31 04:40:31.235201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 370/786] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:31 2022] GET /compute/v2.1/servers/aaed2599-c3cc-4ac7-91be-29c314bf23cb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:40:35.615415 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-313759306"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:35.616035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:35.623286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:35.623771 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:35.624200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:35.624893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:35.625365 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:35.625772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:35.759039 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.network.security_group_api [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Removing security group 391ea4e1-6b88-4738-93fb-5e7cfd7a3dad from port f13a5355-33c4-4ae4-aaed-4afc34e93d15 Aug 31 04:40:36.282746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-255243bc-178e-40a8-8573-f55f7f0d0be0 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/action" status: 202 len: 0 microversion: 2.1 time: 0.671551 Aug 31 04:40:36.286616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 417/787] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:40:35 2022] POST /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:40:36.441058 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-31da5740-4940-462a-80cb-b3a48fa198d8 req-f35e5916-2d50-49d8-9eb8-530cf93ca7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72bff5a-e67f-4494-bdea-4971a277e537", "tag": "f13a5355-33c4-4ae4-aaed-4afc34e93d15"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:36.447647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:36.454401 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-31da5740-4940-462a-80cb-b3a48fa198d8 req-f35e5916-2d50-49d8-9eb8-530cf93ca7e0 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:36.454918 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-31da5740-4940-462a-80cb-b3a48fa198d8 req-f35e5916-2d50-49d8-9eb8-530cf93ca7e0 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:36.455342 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-31da5740-4940-462a-80cb-b3a48fa198d8 req-f35e5916-2d50-49d8-9eb8-530cf93ca7e0 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:36.468862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-31da5740-4940-462a-80cb-b3a48fa198d8 req-f35e5916-2d50-49d8-9eb8-530cf93ca7e0 service nova] Creating event network-changed:f13a5355-33c4-4ae4-aaed-4afc34e93d15 for instance c72bff5a-e67f-4494-bdea-4971a277e537 on hv-cinder-85530 Aug 31 04:40:36.473904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-31da5740-4940-462a-80cb-b3a48fa198d8 req-f35e5916-2d50-49d8-9eb8-530cf93ca7e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185671 Aug 31 04:40:36.474518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 371/788] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:37.994988 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:37.996230 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:38.003396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:38.004884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:38.006602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:38.007502 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:38.008016 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:38.008987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:38.117084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lazy-loading 'services' on Instance uuid c72bff5a-e67f-4494-bdea-4971a277e537 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:40:38.214505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fe60d668-b8e3-4883-954e-64aefa6ba464 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments/15260bb0-cc2a-4774-9cbc-cb6c521b8997" status: 202 len: 0 microversion: 2.1 time: 0.223870 Aug 31 04:40:38.219793 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 418/789] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:40:37 2022] DELETE /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments/15260bb0-cc2a-4774-9cbc-cb6c521b8997 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:40:38.230117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:38.240181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:38.248515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:38.249260 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:38.249691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:38.250548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:38.251015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:38.251425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:38.338678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1dc9c01a-f872-4bf8-932c-93f061fdcaf8 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117887 Aug 31 04:40:38.350595 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 372/790] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:40:38 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:40:38.492732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-88d62b52-69d3-4964-88c8-3b6e324d78fb req-5a17b472-4812-4c98-acc3-062e702c91fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72bff5a-e67f-4494-bdea-4971a277e537", "tag": "f13a5355-33c4-4ae4-aaed-4afc34e93d15"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:38.503277 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-88d62b52-69d3-4964-88c8-3b6e324d78fb req-5a17b472-4812-4c98-acc3-062e702c91fc service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:38.504041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-88d62b52-69d3-4964-88c8-3b6e324d78fb req-5a17b472-4812-4c98-acc3-062e702c91fc service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:38.504846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-88d62b52-69d3-4964-88c8-3b6e324d78fb req-5a17b472-4812-4c98-acc3-062e702c91fc service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:38.518540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-88d62b52-69d3-4964-88c8-3b6e324d78fb req-5a17b472-4812-4c98-acc3-062e702c91fc service nova] Creating event network-changed:f13a5355-33c4-4ae4-aaed-4afc34e93d15 for instance c72bff5a-e67f-4494-bdea-4971a277e537 on hv-cinder-85530 Aug 31 04:40:38.524998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-88d62b52-69d3-4964-88c8-3b6e324d78fb req-5a17b472-4812-4c98-acc3-062e702c91fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039378 Aug 31 04:40:38.526077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 419/791] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:39.364448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:39.367989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:39.376546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:39.377031 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:39.377457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:39.378347 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:39.378980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:39.379396 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:39.409596 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3e79de38-d2d5-40ed-abb9-25c9a9087551 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050544 Aug 31 04:40:39.410566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 373/792] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:40:39 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:40:39.433244 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:39.434041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:39.444213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:39.444885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:39.445647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:39.446510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:39.447137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:39.447738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:39.570109 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] HTTP exception thrown: Instance c72bff5a-e67f-4494-bdea-4971a277e537 is not attached to volume 15260bb0-cc2a-4774-9cbc-cb6c521b8997 Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Request method failure captured: Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments/15260bb0-cc2a-4774-9cbc-cb6c521b8997 HTTP/1.1 Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuWIWC85PXkzeuujgUmym3OEIV8QVFZ59UB811Filz7hc3Wpyi8mXdtkqCIKclGXzHOAR9_xSNxm5sXGP5-kz0H8gnAvC7EPUiauHamNaEVA_vfDNy2yGgfD762I8K4sxolB54O4uvwVatKacap8tNYHDloUP_3ROMDAIwI2mStt_Zo Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 6714373199f5419a9a70267187067934 Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-TestMinimumBasicScenario-1327023023 Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:40:39.579004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6714373199f5419a9a70267187067934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6714373199f5419a9a70267187067934", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6714373199f5419a9a70267187067934"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6714373199f5419a9a70267187067934"}]}] Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-TestMinimumBasicScenario-1327023023 Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 6714373199f5419a9a70267187067934 Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1327023023 Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-TestMinimumBasicScenario-1327023023-project Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 6b1139bf460a49d2b0156912be60fa36 Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-TestMinimumBasicScenario-1327023023-project Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:40:39.580412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance c72bff5a-e67f-4494-bdea-4971a277e537 is not attached to volume 15260bb0-cc2a-4774-9cbc-cb6c521b8997 Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'server_id': 'c72bff5a-e67f-4494-bdea-4971a277e537', 'id': '15260bb0-cc2a-4774-9cbc-cb6c521b8997'} Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 15260bb0-cc2a-4774-9cbc-cb6c521b8997. Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:40:39.581101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72bff5a-e67f-4494-bdea-4971a277e537 is not attached to volume 15260bb0-cc2a-4774-9cbc-cb6c521b8997 Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72bff5a-e67f-4494-bdea-4971a277e537 is not attached to volume 15260bb0-cc2a-4774-9cbc-cb6c521b8997 Aug 31 04:40:39.582215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:40:39.584528 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Returning 404 to user: Instance c72bff5a-e67f-4494-bdea-4971a277e537 is not attached to volume 15260bb0-cc2a-4774-9cbc-cb6c521b8997 {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:40:39.586559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5dc3e740-556b-4c5a-a3a3-a4d4fc05c6f7 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments/15260bb0-cc2a-4774-9cbc-cb6c521b8997" status: 404 len: 154 microversion: 2.1 time: 0.168439 Aug 31 04:40:39.592463 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 420/793] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:40:39 2022] DELETE /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537/os-volume_attachments/15260bb0-cc2a-4774-9cbc-cb6c521b8997 => generated 154 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:40:40.771255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:40.772418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:40.780156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:40.780883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:40.781579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:40.782372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:40.782874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:40.783518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:40.811313 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:40:40.931160 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d1f5b287-347b-47bf-96c3-f4af34f47935 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 204 len: 0 microversion: 2.1 time: 0.162715 Aug 31 04:40:40.932020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 374/794] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:40:40 2022] DELETE /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:40:40.940404 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:40.941068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:40.950811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:40.952468 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:40.952895 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:40.953770 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:40.954541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:40.954979 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:41.322263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bf01f890-6a0d-4b40-b41c-7fe8ade26354 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: .version_select at 0x7fc826dc24c0>, body: {"keypair": {"name": "tempest-keypair-1231962491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5+ZunFMevvfFaZXizfF3ZxjQr95EaCrmIprlgS/HLCUcj6GDWlew2Y8SadGQsUrHF0SpHSQ6aAuxQgecgKclhv152ptfg1uQYsxmb/5iEAkuyl8PIFcZ9HKQbi0xzVCw=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:41.348340 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-bf01f890-6a0d-4b40-b41c-7fe8ade26354 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:40:41.352970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-bf01f890-6a0d-4b40-b41c-7fe8ade26354 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:40:41.383942 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bf01f890-6a0d-4b40-b41c-7fe8ade26354 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132393 Aug 31 04:40:41.384714 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 375/795] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:40:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:40:41.433372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:41.442613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cb87c3d7-41ab-410d-bec5-94fa9fa956d6 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1554 microversion: 2.1 time: 0.505958 Aug 31 04:40:41.443665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 421/796] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:40 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1554 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:42.470154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:42.472311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:42.480501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:42.485865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:42.487275 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:42.488222 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:42.489438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:42.493867 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:42.675451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:42.683468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d514ac25-75e9-41a0-9829-c2f1a6020898 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1554 microversion: 2.1 time: 0.219272 Aug 31 04:40:42.684038 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 376/797] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:42 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:42.883017 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1777422940", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5e1d21-0d94-4325-a39c-d7a84e70a79f"}], "security_groups": [{"name": "tempest-securitygroup--1907664718"}], "key_name": "tempest-keypair-1231962491", "user_data": "}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:43.007267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] validate_networks() for [('9f5e1d21-0d94-4325-a39c-d7a84e70a79f', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:40:43.398888 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:40:43.399671 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:40:43.400319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:40:43.400900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:40:43.401532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:40:43.411841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:43.412315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:43.412754 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:43.413464 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:43.413909 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:43.414319 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:43.431305 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:40:43.438517 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:40:43.463571 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:40:43.468294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:40:43.536466 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-a7d37385-ef34-41fe-bf0d-c30ea4a5cbd4 req-50789b40-a216-43cb-843b-7d83a3d24770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72bff5a-e67f-4494-bdea-4971a277e537", "name": "network-vif-deleted", "tag": "f13a5355-33c4-4ae4-aaed-4afc34e93d15"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:43.548196 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-a7d37385-ef34-41fe-bf0d-c30ea4a5cbd4 req-50789b40-a216-43cb-843b-7d83a3d24770 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:43.549012 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-a7d37385-ef34-41fe-bf0d-c30ea4a5cbd4 req-50789b40-a216-43cb-843b-7d83a3d24770 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:43.549648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-a7d37385-ef34-41fe-bf0d-c30ea4a5cbd4 req-50789b40-a216-43cb-843b-7d83a3d24770 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:43.562260 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-a7d37385-ef34-41fe-bf0d-c30ea4a5cbd4 req-50789b40-a216-43cb-843b-7d83a3d24770 service nova] Creating event network-vif-deleted:f13a5355-33c4-4ae4-aaed-4afc34e93d15 for instance c72bff5a-e67f-4494-bdea-4971a277e537 on hv-cinder-85530 Aug 31 04:40:43.567983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4b10e4af-c035-4cab-bb44-7dbd7bc9145a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.689357 Aug 31 04:40:43.568633 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 422/798] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:40:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:40:43.579996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-54347dca-1bd5-47e5-9206-3f77d3b402b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:43.580852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-54347dca-1bd5-47e5-9206-3f77d3b402b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:43.586708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-a7d37385-ef34-41fe-bf0d-c30ea4a5cbd4 req-50789b40-a216-43cb-843b-7d83a3d24770 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053711 Aug 31 04:40:43.587361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 377/799] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:43.663260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-54347dca-1bd5-47e5-9206-3f77d3b402b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:43.671840 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-54347dca-1bd5-47e5-9206-3f77d3b402b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1242 microversion: 2.1 time: 0.095842 Aug 31 04:40:43.674266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 423/800] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:43 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:40:43.708080 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:43.708811 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:43.715856 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:43.716338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:43.716770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:43.717463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:43.717907 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:43.718319 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:43.752943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:43.753374 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:43.753799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:43.754274 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lazy-loading 'fault' on Instance uuid c72bff5a-e67f-4494-bdea-4971a277e537 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:40:43.806957 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1139bf460a49d2b0156912be60fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714373199f5419a9a70267187067934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:43.817144 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f649896-d6d4-4592-bb93-ab994d27fb8d tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 200 len: 1348 microversion: 2.1 time: 0.114078 Aug 31 04:40:43.817916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 378/801] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:43 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:44.696131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:44.696742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:44.703648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:44.704289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:44.704718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:44.705265 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:44.705705 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:44.706314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:44.772609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:44.781264 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-538fa97d-adbe-4a5e-b707-ec513979dfa2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1294 microversion: 2.1 time: 0.088930 Aug 31 04:40:44.781870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 424/802] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:44 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:44.839242 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:44.839849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] [instance: c72bff5a-e67f-4494-bdea-4971a277e537] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:44.846830 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:44.847309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:44.847735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:44.848429 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:44.848975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:44.849391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:44.864277 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] HTTP exception thrown: Instance c72bff5a-e67f-4494-bdea-4971a277e537 could not be found. Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Request method failure captured: Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 HTTP/1.1 Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuWIWC85PXkzeuujgUmym3OEIV8QVFZ59UB811Filz7hc3Wpyi8mXdtkqCIKclGXzHOAR9_xSNxm5sXGP5-kz0H8gnAvC7EPUiauHamNaEVA_vfDNy2yGgfD762I8K4sxolB54O4uvwVatKacap8tNYHDloUP_3ROMDAIwI2mStt_Zo Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 6714373199f5419a9a70267187067934 Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestMinimumBasicScenario-1327023023 Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:40:44.865963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6714373199f5419a9a70267187067934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6714373199f5419a9a70267187067934", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6714373199f5419a9a70267187067934"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6714373199f5419a9a70267187067934"}]}] Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestMinimumBasicScenario-1327023023 Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 6714373199f5419a9a70267187067934 Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1327023023 Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-TestMinimumBasicScenario-1327023023-project Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 6b1139bf460a49d2b0156912be60fa36 Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestMinimumBasicScenario-1327023023-project Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance c72bff5a-e67f-4494-bdea-4971a277e537 could not be found. Aug 31 04:40:44.867518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': 'c72bff5a-e67f-4494-bdea-4971a277e537'} Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72bff5a-e67f-4494-bdea-4971a277e537 could not be found. Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:40:44.868284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72bff5a-e67f-4494-bdea-4971a277e537 could not be found. Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72bff5a-e67f-4494-bdea-4971a277e537 could not be found. Aug 31 04:40:44.869657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:40:44.871704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Returning 404 to user: Instance c72bff5a-e67f-4494-bdea-4971a277e537 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:40:44.871704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dcec1f2e-1cb5-435f-8556-24f759dace4c tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537" status: 404 len: 111 microversion: 2.1 time: 0.032252 Aug 31 04:40:44.871704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 379/803] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:44 2022] GET /compute/v2.1/servers/c72bff5a-e67f-4494-bdea-4971a277e537 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:40:44.877092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b94e74b4-7097-4171-8df4-77d36a995849 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] Calling method '.version_select at 0x7fc82a8a0550>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:44.899418 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b94e74b4-7097-4171-8df4-77d36a995849 tempest-TestMinimumBasicScenario-1327023023 tempest-TestMinimumBasicScenario-1327023023-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-592710292" status: 202 len: 0 microversion: 2.1 time: 0.026161 Aug 31 04:40:44.900326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 425/804] 10.222.0.42 () {58 vars in 1269 bytes} [Wed Aug 31 04:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-592710292 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:40:45.802281 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:45.803028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:45.809752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:45.810665 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:45.811122 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:45.813494 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:45.814128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:45.814731 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:46.068426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:46.083836 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-13649755-8908-4420-be3d-1732a2a845dd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1368 microversion: 2.1 time: 0.285184 Aug 31 04:40:46.085392 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 380/805] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:45 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:46.555103 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-8825b320-3de9-472d-8702-195e3bd796b7 req-bafea080-c88e-4d68-94b4-d1cd4f4130fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367213be-b6d0-4465-ab62-f280b288b2fb", "tag": "7e1f8894-0351-476c-8955-19dca2560661"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:46.571938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-8825b320-3de9-472d-8702-195e3bd796b7 req-bafea080-c88e-4d68-94b4-d1cd4f4130fe service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:46.572756 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-8825b320-3de9-472d-8702-195e3bd796b7 req-bafea080-c88e-4d68-94b4-d1cd4f4130fe service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:46.573412 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-8825b320-3de9-472d-8702-195e3bd796b7 req-bafea080-c88e-4d68-94b4-d1cd4f4130fe service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:46.598621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-8825b320-3de9-472d-8702-195e3bd796b7 req-bafea080-c88e-4d68-94b4-d1cd4f4130fe service nova] Creating event network-changed:7e1f8894-0351-476c-8955-19dca2560661 for instance 367213be-b6d0-4465-ab62-f280b288b2fb on hv-cinder-85530 Aug 31 04:40:46.616883 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-8825b320-3de9-472d-8702-195e3bd796b7 req-bafea080-c88e-4d68-94b4-d1cd4f4130fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072711 Aug 31 04:40:46.617684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 426/806] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:47.116268 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:47.117561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:47.125749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:47.126507 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:47.127114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:47.128023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:47.128618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:47.129195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:47.287023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:47.299843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-05a85d6e-e121-4262-89c8-5b8f44959aee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1368 microversion: 2.1 time: 0.194055 Aug 31 04:40:47.300797 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 381/807] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:47 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:48.322784 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:48.323489 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:48.330586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:48.331469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:48.332733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:48.333645 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:48.334157 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:48.334501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:48.337827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:48.755241 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:48.763063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2ea20fa9-570f-4bae-ae60-e8acf93cf522 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1368 microversion: 2.1 time: 0.445019 Aug 31 04:40:48.776312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 427/808] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:48 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1368 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:49.784090 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:49.784916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:49.792455 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:49.793039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:49.793831 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:49.795532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:49.796096 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:49.796770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:49.815564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:49.955861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:49.965857 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a5cc84f1-3258-4547-a400-bf1d088d9b44 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1368 microversion: 2.1 time: 0.185535 Aug 31 04:40:49.967167 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 382/809] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:49 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:50.991360 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:50.993188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:51.001150 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:51.002070 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:51.002732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:51.003898 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:51.004599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:51.005170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:51.258776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:51.267647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6db7db8b-cc9b-47a0-ae9e-d5a743991c1f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1368 microversion: 2.1 time: 0.280611 Aug 31 04:40:51.268312 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 428/810] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:50 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:40:51.911518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:51.912097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:51.914735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:51.929736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:51.930500 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:51.931358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:51.932287 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:51.934232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:51.934941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:51.981700 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-235ba519-17e0-408d-82d8-27cc9f1517e4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/ips" status: 200 len: 152 microversion: 2.20 time: 0.073185 Aug 31 04:40:51.990865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 383/811] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 31 04:40:51 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/ips => generated 152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:40:52.290946 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:52.291558 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:52.331385 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:52.342070 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:52.342618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:52.344935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:52.345410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:52.345815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:52.358383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-fcf7fe6e-fa5e-44ec-9564-52d988e38956 req-bc056862-8a77-4e60-90b1-c82307188a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367213be-b6d0-4465-ab62-f280b288b2fb", "name": "network-vif-plugged", "status": "completed", "tag": "7e1f8894-0351-476c-8955-19dca2560661"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:52.372114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-fcf7fe6e-fa5e-44ec-9564-52d988e38956 req-bc056862-8a77-4e60-90b1-c82307188a95 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:52.373000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-fcf7fe6e-fa5e-44ec-9564-52d988e38956 req-bc056862-8a77-4e60-90b1-c82307188a95 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:52.373653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-fcf7fe6e-fa5e-44ec-9564-52d988e38956 req-bc056862-8a77-4e60-90b1-c82307188a95 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:52.409379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-fcf7fe6e-fa5e-44ec-9564-52d988e38956 req-bc056862-8a77-4e60-90b1-c82307188a95 service nova] Creating event network-vif-plugged:7e1f8894-0351-476c-8955-19dca2560661 for instance 367213be-b6d0-4465-ab62-f280b288b2fb on hv-cinder-85530 Aug 31 04:40:52.431193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-fcf7fe6e-fa5e-44ec-9564-52d988e38956 req-bc056862-8a77-4e60-90b1-c82307188a95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207918 Aug 31 04:40:52.431193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 429/812] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:52.536992 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:52.545325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a0a39d37-b856-4460-90e5-8c6499da854a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1368 microversion: 2.1 time: 0.260425 Aug 31 04:40:52.545832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 384/813] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:52 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:40:53.573355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:53.575106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:53.579597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:53.581948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:53.587922 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:53.588396 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:53.588898 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:53.589595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:53.590040 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:53.592613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:53.667829 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=8 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:40:53.742523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:53.750563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c665405a-cbf6-40f2-be25-2ecec01df57a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1368 microversion: 2.1 time: 0.184631 Aug 31 04:40:53.751314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 430/814] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:53 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:54.064881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:54.066917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:54.075331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:54.076233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:54.076697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:54.077512 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:54.077968 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:54.078389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:54.102655 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lazy-loading 'flavor' on Instance uuid 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:40:54.292669 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1095402c-527b-489e-b238-c3954452ba14 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/action" status: 202 len: 0 microversion: 2.20 time: 0.231915 Aug 31 04:40:54.293773 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 385/815] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 04:40:54 2022] POST /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:40:54.303218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:54.306688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:54.338466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:54.339092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:54.339587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:54.340505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:54.341107 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:54.341579 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:54.475152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:54.484066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:54.485731 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:54.486940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c484c853-5911-4464-b14b-82cb11ef6f35 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.188886 Aug 31 04:40:54.487502 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 431/816] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:54 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:54.772852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:54.778073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:54.786800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:54.787193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:54.787625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:54.788328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:54.788793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:54.789444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:54.999478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:55.008783 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-854b296c-1d00-4ee5-b030-b91fcba2aea2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1559 microversion: 2.1 time: 0.240099 Aug 31 04:40:55.009958 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 386/817] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:40:54 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1559 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:40:55.031676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:55.032946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:55.043573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:55.044399 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:55.045215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:55.047222 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:55.047863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:55.050001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:55.370956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-850238fb-b055-40b3-9b7b-73d0841b56b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344795 Aug 31 04:40:55.371985 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 432/818] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:40:55 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-interface => generated 285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:55.509872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:55.510472 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:55.526257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:55.536419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:55.536896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:55.538501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:55.543404 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:55.544117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:55.965109 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:55.974784 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:55.980577 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:55.983192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-80512e9b-00a3-4a8a-92c5-2b4ca39961c4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.477411 Aug 31 04:40:55.986788 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 387/819] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:55 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:56.920043 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-42470f1f-c8a6-4170-b6a1-ef7a75d4137a req-224ee4bd-d018-448d-a0ef-2b8086d6e100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367213be-b6d0-4465-ab62-f280b288b2fb", "tag": "7e1f8894-0351-476c-8955-19dca2560661"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:40:56.935804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-42470f1f-c8a6-4170-b6a1-ef7a75d4137a req-224ee4bd-d018-448d-a0ef-2b8086d6e100 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:56.936667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-42470f1f-c8a6-4170-b6a1-ef7a75d4137a req-224ee4bd-d018-448d-a0ef-2b8086d6e100 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:56.937304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-42470f1f-c8a6-4170-b6a1-ef7a75d4137a req-224ee4bd-d018-448d-a0ef-2b8086d6e100 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:56.951450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-42470f1f-c8a6-4170-b6a1-ef7a75d4137a req-224ee4bd-d018-448d-a0ef-2b8086d6e100 service nova] Creating event network-changed:7e1f8894-0351-476c-8955-19dca2560661 for instance 367213be-b6d0-4465-ab62-f280b288b2fb on hv-cinder-85530 Aug 31 04:40:56.957900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-42470f1f-c8a6-4170-b6a1-ef7a75d4137a req-224ee4bd-d018-448d-a0ef-2b8086d6e100 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041699 Aug 31 04:40:56.959159 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 433/820] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:40:57.009121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:57.009935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:57.018643 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:57.019793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:57.020294 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:57.021084 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:57.021543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:57.021962 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:57.278366 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:57.295394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:57.298937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:57.300765 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-84a5cfea-0f9a-46ef-9e5c-3ac32d87a217 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.295595 Aug 31 04:40:57.301567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 388/821] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:57 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:40:58.331876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:58.333499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:58.340272 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:58.341041 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:58.341556 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:58.342418 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:58.343024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:58.343710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:58.555510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:58.578411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:58.580714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:58.582516 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6b9da4dd-0a06-4041-9f6e-4ccb9a355418 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.261336 Aug 31 04:40:58.596153 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 434/822] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:58 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:40:59.607155 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:40:59.607767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:40:59.621775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:59.622551 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:59.624047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:59.625163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:40:59.625939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:40:59.626192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:40:59.837565 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:59.846190 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:59.848020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:40:59.849462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-774a7ee5-2ed8-48fb-b405-e8769f86ce94 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.246557 Aug 31 04:40:59.849742 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 389/823] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:40:59 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:00.873128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:00.874947 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:00.905852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:00.906603 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:00.909122 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:00.915495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:00.915495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:00.926524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:01.101070 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:01.122673 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:01.127871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:01.133901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fb803a69-8e70-4976-b519-789faf527b30 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.264916 Aug 31 04:41:01.134506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 435/824] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:00 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:02.160484 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:02.161784 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:02.174519 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:02.175524 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:02.175976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:02.176699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:02.186418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:02.187028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:02.376057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:02.387195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:02.389478 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:02.392384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-05233e0a-afee-4685-8176-ceee086d68e5 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.238164 Aug 31 04:41:02.403655 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 390/825] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:02 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:02.433061 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:02.434221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:02.441660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:02.442517 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:02.443163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:02.444083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:02.444738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:02.445354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:02.475875 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6d8069cd-e90e-44a7-a6ae-3fb8444241f3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/ips" status: 200 len: 146 microversion: 2.1 time: 0.046587 Aug 31 04:41:02.477174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 436/826] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:41:02 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:03.422177 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:03.423512 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:03.430518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:03.431040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:03.431440 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:03.434879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:03.435887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:03.436320 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:03.581038 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:03.590234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:03.593374 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:03.594581 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c054b310-03b8-4749-84d6-52f44f88f74f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.181411 Aug 31 04:41:03.595632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 391/827] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:03 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:04.002926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63ff5483-354b-4d69-bdd0-70b8cbe2eb21"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:04.005506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:04.012196 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:04.012691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:04.013592 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:04.014456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:04.015081 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:04.015686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:04.290854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3b9c00dc-73db-4ef1-b398-10d7150f7660 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Action: 'create', calling method: .version_select at 0x7fc826e2fe50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1950589606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKXMu3KkCg5pKLQlXT509HSvUtXLGh+CMqhrLScqqrbo3w25Zpc5/QyBg5pbbRxeQo5HKS1DSowDqQGf0WFWZ+YZH3VTSnaiBF2MKjJB40rDOKRQJysmQZ3vugxWfJlA=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:04.306741 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3b9c00dc-73db-4ef1-b398-10d7150f7660 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:41:04.311244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3b9c00dc-73db-4ef1-b398-10d7150f7660 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for user c11d44667e8e4db5bccccaee16d89a51 and project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:41:04.340153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3b9c00dc-73db-4ef1-b398-10d7150f7660 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.260610 Aug 31 04:41:04.340896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 392/828] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:41:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:04.351765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-962f16dd-685a-4275-a342-49e3ca7989af tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352387 Aug 31 04:41:04.353168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 437/829] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:41:03 2022] POST /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:04.620748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:04.621363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:04.628108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:04.628716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:04.629483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:04.630621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:04.631414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:04.631983 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:04.794692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:04.808890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:04.810832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:04.812240 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8d7d1b72-fe19-41f8-a141-993b9f5caf1e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.196503 Aug 31 04:41:04.827359 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 393/830] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:04 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:05.838490 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:05.839187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:05.846215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:05.846695 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:05.847150 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:05.848097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:05.849355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:05.850001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:06.037681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:06.049449 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:06.050999 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:06.052258 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a2907a5f-bf14-4f7f-9938-a7726782fab7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1743 microversion: 2.20 time: 0.219517 Aug 31 04:41:06.053184 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 438/831] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:05 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:07.082355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:07.082997 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:07.085515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:07.091360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:07.091825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:07.092253 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:07.092937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:07.093373 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:07.093774 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:07.231262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:07.239821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:07.241244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:07.242403 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-886418a5-ac14-4433-85c1-a0c94ec0ff5f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1743 microversion: 2.20 time: 0.166511 Aug 31 04:41:07.243060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 394/832] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:07 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:08.038765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-18787d45-d860-456e-9c23-5415fcb833dc req-a92277ef-5622-4631-b70b-0524a291adc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff76b8-6b3d-47fc-9e88-95c76e7bd11f", "name": "network-vif-plugged", "status": "completed", "tag": "e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:08.049466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-18787d45-d860-456e-9c23-5415fcb833dc req-a92277ef-5622-4631-b70b-0524a291adc2 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:08.050174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-18787d45-d860-456e-9c23-5415fcb833dc req-a92277ef-5622-4631-b70b-0524a291adc2 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:08.050812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-18787d45-d860-456e-9c23-5415fcb833dc req-a92277ef-5622-4631-b70b-0524a291adc2 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:08.067679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-18787d45-d860-456e-9c23-5415fcb833dc req-a92277ef-5622-4631-b70b-0524a291adc2 service nova] Creating event network-vif-plugged:e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8 for instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f on hv-cinder-85530 Aug 31 04:41:08.104007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-18787d45-d860-456e-9c23-5415fcb833dc req-a92277ef-5622-4631-b70b-0524a291adc2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068785 Aug 31 04:41:08.104616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 439/833] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:08.266136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:08.267505 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:08.278852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:08.279754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:08.280468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:08.281300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:08.281821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:08.283584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:08.475244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:08.489289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:08.491263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:08.492690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9664b5d4-cc1e-4da2-bb74-becf13ab1bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.231280 Aug 31 04:41:08.507527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 395/834] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:08 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:09.519609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:09.520413 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:09.527067 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:09.527707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:09.528439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:09.530008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:09.530526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:09.530987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:09.705997 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:09.716558 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:09.718160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:09.719501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-33fee888-86aa-4406-a7b2-0741d7c07c52 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.205006 Aug 31 04:41:09.720679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 440/835] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:09 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:10.748256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:10.750378 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:10.758552 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:10.761905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:10.762356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:10.763225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:10.763898 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:10.764314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:10.945953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:10.954703 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:10.956141 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:10.957334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1ee3cc20-6faf-4e0b-9a4c-3db63c4f53bc tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.214036 Aug 31 04:41:10.957895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 396/836] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:10 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:11.980996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:11.982884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:11.994785 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:11.995272 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:11.995695 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:11.996385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:11.996826 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:11.997269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:12.064195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:12.067306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:12.077763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:12.078261 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:12.078689 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:12.079454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:12.080059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:12.080624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:12.130116 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7019b639-fc63-44ac-ab85-980573e84d2f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070930 Aug 31 04:41:12.131317 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 397/837] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:41:12 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:41:12.145798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:12.146666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:12.153698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:12.154452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:12.155257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:12.156297 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:12.156924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:12.157616 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:12.172318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:12.174459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:12.194965 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:12.197688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:12.202336 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7789af5d-4902-457d-8195-45c5d1cd15e7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.225079 Aug 31 04:41:12.203523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 441/838] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:11 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:12.215336 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5601f99b-efe4-4a78-8fb8-eadae9a40e19 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/63ff5483-354b-4d69-bdd0-70b8cbe2eb21" status: 200 len: 194 microversion: 2.1 time: 0.076968 Aug 31 04:41:12.216901 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 398/839] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 31 04:41:12 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/63ff5483-354b-4d69-bdd0-70b8cbe2eb21 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:41:13.239330 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:13.240543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:13.248118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:13.248863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:13.249696 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:13.250598 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:13.251233 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:13.251809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:13.431210 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:13.448400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:13.450101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:13.451985 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3e39d906-f14b-45d3-91cb-a95019d6a360 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.222800 Aug 31 04:41:13.452818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 442/840] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:13 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:13.644490 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b4700a0-5714-49b9-8c3f-a237ab3b68cc"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:13.646864 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:13.657547 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:13.658032 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:13.658461 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:13.659183 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:13.659634 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:13.661102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:13.987663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-34d38cdf-4a57-424d-ae89-517e87830cf7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "POST /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350829 Aug 31 04:41:13.988653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 399/841] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:41:13 2022] POST /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:14.474684 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:14.475962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:14.487084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:14.487658 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:14.488141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:14.489331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:14.489930 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:14.490707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:14.649435 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:14.658129 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:14.659998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:14.662523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a5281ab7-b652-45ae-96f0-d489a532b6b0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.191221 Aug 31 04:41:14.678402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 443/842] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:14 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:15.683284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:15.688707 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:15.689730 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:15.698760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:15.699787 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:15.700379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:15.701457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:15.702353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:15.703021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:15.855420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:15.872819 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:15.874855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:15.876444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-66dfffc9-b867-4c2a-a6e0-bdf88306c4f0 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.194602 Aug 31 04:41:15.894574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 400/843] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:15 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:16.904728 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:16.906123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:16.913186 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:16.913732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:16.914395 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:16.915181 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:16.915824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:16.916433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:17.062465 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:17.076653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:17.079207 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:17.081207 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c9b4ba32-216a-4f1e-817b-8050a8c7c919 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1738 microversion: 2.20 time: 0.180785 Aug 31 04:41:17.082213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 444/844] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:16 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:18.105211 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:18.105831 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:18.113061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:18.113534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:18.113980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:18.114666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:18.115138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:18.115554 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:18.312396 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:18.322639 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:18.324073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:18.325338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0eca5272-636d-4700-a80c-9572ea1ca406 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1720 microversion: 2.20 time: 0.224129 Aug 31 04:41:18.338737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 401/845] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:18 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:19.354907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:19.356023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:19.365410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:19.365892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:19.366315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:19.367051 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:19.367555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:19.367960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:19.370739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:19.502933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:19.515169 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:19.516765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:19.517921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a4cba57e-3ebc-4f98-9233-41b78fa61c3e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1720 microversion: 2.20 time: 0.170420 Aug 31 04:41:19.518480 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 445/846] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:19 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:20.540601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:20.541230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:20.548036 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:20.548510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:20.548926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:20.549607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:20.550072 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:20.550498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:20.688098 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:20.696574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:20.697987 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:20.699167 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9d6aecbc-23a6-4f8b-a26a-824ac80ed6b4 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1720 microversion: 2.20 time: 0.162510 Aug 31 04:41:20.699775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 402/847] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:20 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:21.603836 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:21.607022 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:21.615038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.615512 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.615938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.616641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.617050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.617465 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.647673 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-14c50b21-77cc-4c93-9c88-d5a743684738 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050159 Aug 31 04:41:21.648205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 446/848] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:41:21 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:21.722323 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:21.722961 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:21.729574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.730054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.730474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.731191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.731626 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.732039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.803736 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:21.804271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:21.811170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.811667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.812092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.813423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.813553 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.818574 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.850744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c571af9c-7156-4f17-bcc7-2fa81cdfc149 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/63ff5483-354b-4d69-bdd0-70b8cbe2eb21" status: 200 len: 194 microversion: 2.1 time: 0.053158 Aug 31 04:41:21.851490 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 447/849] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 31 04:41:21 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/63ff5483-354b-4d69-bdd0-70b8cbe2eb21 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:41:21.864022 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:21.864507 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:21.871263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:21.872114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.872663 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.873159 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.873926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.874493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.874998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.882043 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:21.883534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:21.884686 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1215f661-8f6e-4e9a-b8d1-42a446517cc6 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1723 microversion: 2.20 time: 0.166390 Aug 31 04:41:21.885233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 403/850] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:21 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:21.909432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05f6a762-8cf9-43e7-ab90-ea44c61a5998"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:21.912537 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:21.918843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.919517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.920093 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.920936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:21.921539 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:21.922117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:21.971891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lazy-loading 'services' on Instance uuid 9472a4bc-d255-45a5-a6b0-016a1bd62606 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:41:22.069111 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-355f1c42-8215-485e-9c53-21c553116d79 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/63ff5483-354b-4d69-bdd0-70b8cbe2eb21" status: 202 len: 0 microversion: 2.1 time: 0.208992 Aug 31 04:41:22.073158 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 448/851] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:41:21 2022] DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/63ff5483-354b-4d69-bdd0-70b8cbe2eb21 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:41:22.086836 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1233115769", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1950589606", "security_groups": [{"name": "tempest-secgroup-smoke-2075500102"}], "block_device_mapping_v2": [{"uuid": "46960b11-0be0-411c-8e90-0fb2b8aceec5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c418a9e6-611c-4446-9f40-8356037355dc"}]}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:22.253382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] validate_networks() for [('c418a9e6-611c-4446-9f40-8356037355dc', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:41:22.289021 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-24f3336f-8bc4-493d-a08c-076683158548 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.386173 Aug 31 04:41:22.295308 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 404/852] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Aug 31 04:41:21 2022] POST /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-volume_attachments => generated 188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 04:41:22.295308 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-2e525067-a596-45a9-9508-b63a5d89c4b2 req-4bc87ef4-52d3-43a5-95ca-e62d64e1623b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff76b8-6b3d-47fc-9e88-95c76e7bd11f", "name": "network-vif-unplugged", "status": "completed", "tag": "e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:22.305175 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2e525067-a596-45a9-9508-b63a5d89c4b2 req-4bc87ef4-52d3-43a5-95ca-e62d64e1623b service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.305651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2e525067-a596-45a9-9508-b63a5d89c4b2 req-4bc87ef4-52d3-43a5-95ca-e62d64e1623b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.306068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2e525067-a596-45a9-9508-b63a5d89c4b2 req-4bc87ef4-52d3-43a5-95ca-e62d64e1623b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.480551 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.compute.server_external_events [req-2e525067-a596-45a9-9508-b63a5d89c4b2 req-4bc87ef4-52d3-43a5-95ca-e62d64e1623b service nova] Unable to find a host for instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f. Dropping event network-vif-unplugged {{(pid=127198) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 04:41:22.481325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-2e525067-a596-45a9-9508-b63a5d89c4b2 req-4bc87ef4-52d3-43a5-95ca-e62d64e1623b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.190582 Aug 31 04:41:22.481876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 405/853] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 192 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 04:41:22.487498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:22.488330 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:22.494425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.494937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.495359 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.496037 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.496473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.496876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.660233 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:41:22.660762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:41:22.661088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:41:22.661489 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:41:22.661884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:41:22.670594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.671085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.671505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.672193 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.672630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.673036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.689744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:41:22.693711 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for user c11d44667e8e4db5bccccaee16d89a51 and project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:41:22.751617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7a42dfa4-1136-4259-931d-0703cfc5a5ae tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-volume_attachments/05f6a762-8cf9-43e7-ab90-ea44c61a5998" status: 202 len: 0 microversion: 2.20 time: 0.268290 Aug 31 04:41:22.752282 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 406/854] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Aug 31 04:41:22 2022] DELETE /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-volume_attachments/05f6a762-8cf9-43e7-ab90-ea44c61a5998 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:41:22.752594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:41:22.755098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46960b11-0be0-411c-8e90-0fb2b8aceec5',volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:41:22.814836 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:22.815430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:22.821853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.822322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.822763 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.823438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.823875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.824279 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.874845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127198) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 04:41:22.888809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bc85a8eb-1ab6-4d99-9ba9-c0293d187e5f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809567 Aug 31 04:41:22.889762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 449/855] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:41:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:41:22.901656 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2ae878ac-474d-4605-a0a8-a1c90451a5e3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:22.902324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2ae878ac-474d-4605-a0a8-a1c90451a5e3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:22.966912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2ae878ac-474d-4605-a0a8-a1c90451a5e3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:22.970801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-57d74a8a-dd33-4c09-a7d0-17e949c73425 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "POST /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/action" status: 202 len: 0 microversion: 2.20 time: 0.160248 Aug 31 04:41:22.971953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 407/856] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 31 04:41:22 2022] POST /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:41:22.979262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2ae878ac-474d-4605-a0a8-a1c90451a5e3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1095 microversion: 2.1 time: 0.082526 Aug 31 04:41:22.981451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:22.982152 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:22.987113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 450/857] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:22 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:22.997662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:22.998363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:22.999071 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:22.999855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:23.000372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:23.000858 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:23.008028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=11,nova_cell1:INSERT=7 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:23.186413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:23.196377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:23.198046 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:23.199676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9ca6bb4f-b387-494f-b70b-595853bf94dd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1671 microversion: 2.20 time: 0.223285 Aug 31 04:41:23.217488 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 408/858] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:22 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:41:24.000852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:24.001573 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:24.006294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:24.012630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.013115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.013546 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.014240 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.014683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.015263 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.077636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:24.086332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-36e2641c-3a92-47f1-9a3b-334b66e99c11 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1193 microversion: 2.1 time: 0.089571 Aug 31 04:41:24.087033 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 451/859] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:23 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:24.237422 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:24.238130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:24.250637 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.251413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.252712 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.253737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.254636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.255100 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.289059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:24.289616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:24.296873 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.298140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.298754 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.299742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.300469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.300984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.339596 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9814c280-aad6-4e18-879b-292aaf3dffa8 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/4b4700a0-5714-49b9-8c3f-a237ab3b68cc" status: 200 len: 194 microversion: 2.1 time: 0.055465 Aug 31 04:41:24.345827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 452/860] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 31 04:41:24 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/4b4700a0-5714-49b9-8c3f-a237ab3b68cc => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:24.356058 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:24.356543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:24.363303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.363788 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.364218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.364912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:24.365354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:24.365773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:24.465062 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lazy-loading 'services' on Instance uuid 9472a4bc-d255-45a5-a6b0-016a1bd62606 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:41:24.547617 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-58a588d5-6e0d-445f-84eb-c702914769a7 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/4b4700a0-5714-49b9-8c3f-a237ab3b68cc" status: 202 len: 0 microversion: 2.1 time: 0.195372 Aug 31 04:41:24.550786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 453/861] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:41:24 2022] DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments/4b4700a0-5714-49b9-8c3f-a237ab3b68cc => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:41:24.715035 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:24.727818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:24.729635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:24.731433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-01e93825-be98-4587-8413-3bbdd11c1036 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1673 microversion: 2.20 time: 0.497661 Aug 31 04:41:24.732209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 409/862] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:24 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1673 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:25.109195 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:25.110541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:25.117232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:25.117700 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:25.118323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:25.119062 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:25.119509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:25.119924 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:25.182120 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:25.191055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-255e5383-fdf4-48d0-9960-ca896a0a7767 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1211 microversion: 2.1 time: 0.086790 Aug 31 04:41:25.191636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 454/863] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:25 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:25.758121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:25.767887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:25.776231 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:25.776870 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:25.777944 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:25.779624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:25.780861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:25.781553 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:26.147506 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:26.156281 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:26.157807 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:26.159272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b3294679-ef43-4246-8e01-7b07e32628b8 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.406510 Aug 31 04:41:26.159832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 410/864] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:25 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:26.211915 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:26.212482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:26.219053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:26.219587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:26.220011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:26.220738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:26.221283 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:26.221681 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:26.365284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:26.373099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2881ea28-f59b-4da7-becc-f2b942bde318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.165157 Aug 31 04:41:26.373734 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 455/865] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:26 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:26.577676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-2d6125b2-a431-4358-85ab-13452cda6bcb req-b07b1e3b-b019-458c-8a40-2a562654765c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1083f879-d1a1-4430-8b82-35a8833d029d", "tag": "6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:26.598846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2d6125b2-a431-4358-85ab-13452cda6bcb req-b07b1e3b-b019-458c-8a40-2a562654765c service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:26.599409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2d6125b2-a431-4358-85ab-13452cda6bcb req-b07b1e3b-b019-458c-8a40-2a562654765c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:26.603185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-2d6125b2-a431-4358-85ab-13452cda6bcb req-b07b1e3b-b019-458c-8a40-2a562654765c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:26.616069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-2d6125b2-a431-4358-85ab-13452cda6bcb req-b07b1e3b-b019-458c-8a40-2a562654765c service nova] Creating event network-changed:6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae for instance 1083f879-d1a1-4430-8b82-35a8833d029d on hv-cinder-85530 Aug 31 04:41:26.621463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-2d6125b2-a431-4358-85ab-13452cda6bcb req-b07b1e3b-b019-458c-8a40-2a562654765c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047508 Aug 31 04:41:26.622414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 411/866] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:41:26.890145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:26.894762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:26.903739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:26.904576 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:26.905226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:26.907537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:26.908704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:26.909300 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:26.976529 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2fc15baa-a4bc-40d0-a23a-d52ef5efa599 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103988 Aug 31 04:41:26.977923 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 456/867] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:41:26 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:41:27.109578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:27.113103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:27.120798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.121605 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.122272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.123329 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.123974 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.124579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.172658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-268d7ae3-08c4-4039-b102-685b8705e63d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069649 Aug 31 04:41:27.174013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 412/868] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:41:27 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:41:27.181928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:27.182683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:27.192798 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.193441 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.193961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.203591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.204351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.204880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.257183 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:27.257930 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:27.278852 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.279258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.279685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.280379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.280821 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.281229 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.314246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:41:27.360390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:27.369417 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:27.370948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:27.372133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9a19aae7-cdda-4236-bd92-6c43f086d992 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.194655 Aug 31 04:41:27.372686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 457/869] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:27 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:27.394594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:27.395733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:27.402289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.403045 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.403639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.404486 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.405075 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.405645 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.425405 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3581d4db-fd31-4c15-b486-23c7194ae290 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 204 len: 0 microversion: 2.1 time: 0.172009 Aug 31 04:41:27.426126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 413/870] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:41:27 2022] DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:41:27.434848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:27.435543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:27.452917 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.453401 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.453825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.454521 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:27.455022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:27.455505 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:27.569971 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:27.578596 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-84f67889-00a6-4061-8ba1-69873c85e38b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.188529 Aug 31 04:41:27.579409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 458/871] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:27 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:41:27.668916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:27.678668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b3db1f93-39ea-4a41-aa75-02b856a2717f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.247853 Aug 31 04:41:27.679632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 414/872] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:27 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:41:28.396500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:28.397121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:28.405320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:28.405877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:28.406362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:28.407215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:28.407726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:28.408266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:28.544175 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:28.552864 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:28.554288 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:28.555475 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4fe56e32-8aa0-4c91-847c-1d5b97af791d tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.164459 Aug 31 04:41:28.556039 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 459/873] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:28 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:28.603114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:28.603813 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:28.612170 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:28.612527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:28.612871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:28.613574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:28.614019 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:28.614438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:28.700370 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:28.700891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:28.708292 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:28.708910 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:28.709414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:28.710323 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:28.711078 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:28.711989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:28.772833 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:28.780587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-87b93de9-9a34-4698-84b8-6122a619144d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.182337 Aug 31 04:41:28.781361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 415/874] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:28 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:28.846174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:28.856928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-060cb401-9785-459f-bb10-a5aa6f5d32f4 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.160814 Aug 31 04:41:28.858666 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 460/875] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:28 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:29.584635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:29.585919 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:29.598395 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:29.600079 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:29.600753 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:29.601668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:29.602550 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:29.602980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:29.746668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:29.755534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:29.756970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:29.758145 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ece3de7b-0a50-4b3c-98e6-8870cd347b3c tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.182216 Aug 31 04:41:29.758757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 416/876] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:29 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:29.802850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:29.803959 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:29.812116 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:29.812944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:29.813502 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:29.814693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:29.815388 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:29.815945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:29.880535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:29.881095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:29.887200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:29.887682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:29.888113 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:29.888805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:29.889250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:29.889662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:29.957449 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:29.965283 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5620cc3e-ddf5-4a8c-9cba-43e79abe6aff tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.167655 Aug 31 04:41:29.965893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 461/877] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:29 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:30.027654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:30.036050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f697d9de-63cd-4c25-88a3-ccbee1809d59 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.159504 Aug 31 04:41:30.036627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 417/878] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:29 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:41:30.781496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:30.782239 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:30.790840 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:30.791343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:30.791908 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:30.792854 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:30.793496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:30.794088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:30.797209 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:30.946613 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:30.956498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:30.957932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:30.963063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-756c9b50-d305-4979-852e-6eec7040ba82 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.182461 Aug 31 04:41:30.963791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 462/879] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:30 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:41:30.985851 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:30.986657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:30.993228 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:30.993706 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:30.994133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:30.994862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:30.995306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:30.995728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:31.056996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:31.057506 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:31.064158 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:31.064372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:31.065017 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:31.065868 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:31.066900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:31.066900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:31.136309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:31.144132 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-63ae2496-b91b-45fd-b29f-5a3686d201ae tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.162537 Aug 31 04:41:31.144700 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 418/880] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:30 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:31.198374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:31.206467 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3ffc7d48-67ba-4961-97d3-15745e4b53e5 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.153516 Aug 31 04:41:31.207281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 463/881] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:31 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:41:31.986122 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:31.987024 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:31.993768 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:31.994259 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:31.994654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:31.995368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:31.995805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:31.996212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:32.137815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:32.146644 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:32.148112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:32.149266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3ceefd9c-e1f8-4b7f-ad0f-48297ad964db tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.167517 Aug 31 04:41:32.149815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 419/882] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:31 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:32.165063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:32.165713 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:32.172540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:32.173038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:32.173449 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:32.174220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:32.174818 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:32.175295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:32.229176 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:32.229893 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:32.243976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:32.244677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:32.245135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:32.246499 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:32.248635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:32.250875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:32.342197 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:32.353677 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-213184f6-3b71-4a18-b854-5778b0d6cf1c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.191601 Aug 31 04:41:32.354982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 464/883] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:32 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:32.414339 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:32.423801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d39c0c05-6d90-456f-9513-b9995572bd90 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.199159 Aug 31 04:41:32.435546 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 420/884] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:32 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:41:33.172068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:33.172694 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:33.174668 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:33.175699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=8 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:33.182021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:33.182499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:33.182984 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:33.183675 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:33.184119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:33.184532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:33.333011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:33.342736 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:33.347505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:33.349097 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-885db970-df33-434f-934b-0c36befa453b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.180910 Aug 31 04:41:33.349895 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 465/885] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:33 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:33.379038 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:33.379661 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:33.386981 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:33.387895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:33.388355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:33.389062 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:33.389503 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:33.389924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:33.446510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:33.447138 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:33.454493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:33.454999 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:33.456868 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:33.457834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:33.458302 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:33.458749 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:33.532883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:33.541377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bafa841d-d27d-4834-886a-f6d8b01e36bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.166332 Aug 31 04:41:33.542094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 421/886] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:33 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:33.600394 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:33.618554 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e1a4acdb-e61a-4a1f-b1a6-6b401c9d48e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.175877 Aug 31 04:41:33.630332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 466/887] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:33 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:34.372676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:34.373316 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:34.379812 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:34.380604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:34.380735 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:34.381367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:34.381801 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:34.382215 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:34.528679 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:34.540020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:34.541731 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:34.543198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8e9ebe14-7d8d-47b9-b290-1b46e075afc9 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.174572 Aug 31 04:41:34.544136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 422/888] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:34 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:34.564067 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:34.564765 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:34.572180 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:34.572686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:34.573147 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:34.573844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:34.574289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:34.574704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:34.643892 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:34.644458 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:34.650522 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:34.651029 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:34.651456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:34.652133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:34.652582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:34.653462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:34.715725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:34.724119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-79062fe8-d435-489b-adbf-bce18c1a68a0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.163987 Aug 31 04:41:34.726250 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 467/889] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:34 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:34.814357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:34.818284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:34.823230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5ad0d87b-7f2b-4f68-925a-b9bccadd49f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.183362 Aug 31 04:41:34.823793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 423/890] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:34 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:35.566118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:35.567057 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:35.574406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:35.575053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:35.575482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:35.576174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:35.576624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:35.577042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:35.716211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:35.725127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:35.726611 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:35.727856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cf235713-bee2-4ad4-b2f0-0354a4741bd1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.165822 Aug 31 04:41:35.728615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 468/891] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:35 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:35.747313 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:35.747991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:35.756804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:35.757268 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:35.757691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:35.758463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:35.758948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:35.759816 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:35.844509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:35.845535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:35.858018 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:35.858509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:35.858975 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:35.859650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:35.860096 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:35.860500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:35.923523 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:35.931759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d3e1d05c-047c-4041-957a-286497ef9f40 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.189018 Aug 31 04:41:35.932322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 424/892] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:35 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:35.992466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:36.000221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-71d3caf4-4ce4-4696-8386-5227973aa2d2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.159939 Aug 31 04:41:36.000789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 469/893] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:35 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:36.757753 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:36.758652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:36.769647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:36.770474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:36.771231 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:36.771931 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:36.772372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:36.772780 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:36.916446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:36.925624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:36.927957 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:36.929531 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1025660c-09c4-4265-8dbd-55ec5b010394 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.178362 Aug 31 04:41:36.930243 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 425/894] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:36 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:36.952464 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:36.953071 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:36.959742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:36.960218 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:36.960646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:36.961299 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:36.961752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:36.962158 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:37.021869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:37.022410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:37.028898 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:37.029455 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:37.029923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:37.030618 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:37.031100 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:37.031519 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:37.102062 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:37.110176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e07c1543-a24a-4266-8b69-ccaf4787fb6a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.161639 Aug 31 04:41:37.110764 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 470/895] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:36 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:37.195163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:37.203074 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4690dd20-a7dc-40f5-b56d-cf7c2497047d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.185248 Aug 31 04:41:37.203640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 426/896] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:37 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:37.960943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:37.961567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:37.968141 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:37.968627 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:37.969053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:37.969743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:37.970188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:37.970616 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:38.105433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:38.114228 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:38.115762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:38.116948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-16155176-e937-4559-a55f-433b2c0ca949 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.162237 Aug 31 04:41:38.117469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 471/897] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:37 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:38.130919 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:38.131594 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:38.134095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:38.139563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:38.140011 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:38.140441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:38.141138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:38.141581 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:38.142000 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:38.225074 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:38.225669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:38.231955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:38.232429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:38.233214 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:38.233893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:38.234320 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:38.234748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:38.278879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:38.287124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3b64b5a0-8504-4ab8-bd4a-aceb3c62a77d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.160231 Aug 31 04:41:38.287922 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 427/898] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:38 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:38.367636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:38.375971 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-96e07a49-0dd6-4fe3-b80b-e13f1613e07c tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.154990 Aug 31 04:41:38.376515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 472/899] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:38 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:39.140355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:39.140973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:39.148139 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:39.148621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:39.149075 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:39.149764 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:39.150239 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:39.150732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:39.300295 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:39.307202 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:39.307803 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:39.310613 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:39.312132 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:39.313296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-669ac70c-15e2-4182-94d2-fb35ac699597 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.177023 Aug 31 04:41:39.313886 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 428/900] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:39 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:39.314315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:39.314786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:39.315209 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:39.315891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:39.316337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:39.316741 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:39.397624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:39.398238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:39.404800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:39.405279 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:39.405703 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:39.406750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:39.406900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:39.407283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:39.452945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:39.460932 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-15c036b1-4601-435f-a937-6b6d9f3cd30a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.157557 Aug 31 04:41:39.461515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 473/901] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:39 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:39.562804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:39.574885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-10f392ff-a578-4afc-8ec8-cb478bd8c3d0 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.181135 Aug 31 04:41:39.575622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 429/902] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:39 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:40.336299 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:40.337049 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:40.343566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.344044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.344462 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.345158 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.345595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.346006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.476530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:40.486099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:40.487638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:40.488487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:40.489365 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9742320d-77e0-4fb5-88e6-41bf24fbee1f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.156721 Aug 31 04:41:40.489488 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:40.496736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.497184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.497548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.498307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.498778 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.499229 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.502937 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 474/903] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:40 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:40.599925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:40.600566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:40.607433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.608297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.608742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.609445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.609897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.610377 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.750572 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:40.759781 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ec3797f8-320e-4921-9a2f-930dbe21eafe tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1674 microversion: 2.1 time: 0.164000 Aug 31 04:41:40.760361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 475/904] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:40 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:40.940090 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:40.940830 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:40.948220 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.948713 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.949140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.950748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:40.951376 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:40.951561 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:40.977622 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0c92d38c-4325-49fe-b851-fdffcbfd6150 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/ips" status: 200 len: 150 microversion: 2.1 time: 0.042604 Aug 31 04:41:40.978194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 476/905] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:41:40 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:41.023259 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:41.032742 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bd7dbd2a-fb64-4ce1-a513-cd0258859ff0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.548524 Aug 31 04:41:41.033760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 430/906] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:40 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:41.449306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-f7f8a905-b058-48b3-8c47-3748eab82bed req-c84014b1-eb0a-4abd-94bc-f7b9082c661f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9472a4bc-d255-45a5-a6b0-016a1bd62606", "name": "network-vif-deleted", "tag": "e93ec718-bb93-4cf8-88f6-b2a75cf59395"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:41.462128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-f7f8a905-b058-48b3-8c47-3748eab82bed req-c84014b1-eb0a-4abd-94bc-f7b9082c661f service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:41.462608 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-f7f8a905-b058-48b3-8c47-3748eab82bed req-c84014b1-eb0a-4abd-94bc-f7b9082c661f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:41.463256 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-f7f8a905-b058-48b3-8c47-3748eab82bed req-c84014b1-eb0a-4abd-94bc-f7b9082c661f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:41.476084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-f7f8a905-b058-48b3-8c47-3748eab82bed req-c84014b1-eb0a-4abd-94bc-f7b9082c661f service nova] Creating event network-vif-deleted:e93ec718-bb93-4cf8-88f6-b2a75cf59395 for instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 on hv-cinder-85530 Aug 31 04:41:41.481606 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-f7f8a905-b058-48b3-8c47-3748eab82bed req-c84014b1-eb0a-4abd-94bc-f7b9082c661f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036417 Aug 31 04:41:41.482430 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 477/907] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:41.514059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:41.514652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:41.523132 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:41.523540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:41.523966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:41.524658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:41.525100 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:41.525512 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:41.662893 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:41.671497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:41.672993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:41.674195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-47fa99a3-5d7d-48fa-bc7d-aeac310cab1b tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.164562 Aug 31 04:41:41.674971 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 431/908] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:41 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:41.782260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:41.783128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:41.789466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:41.790046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:41.790538 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:41.791316 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:41.791826 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:41.792327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:41.823519 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:41.823994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:41.824401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:41.824823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lazy-loading 'fault' on Instance uuid 9472a4bc-d255-45a5-a6b0-016a1bd62606 {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:41:41.874912 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718418f954f94dad93eeb725e345c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94afda48b8e545dfaeac33a66f592fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:41.891285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a2173725-8891-41a1-817b-c88c62b48480 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 200 len: 1327 microversion: 2.1 time: 0.112845 Aug 31 04:41:41.892450 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 478/909] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:41 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:42.054559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:42.055493 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:42.075995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.076514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.076948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.077636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.078082 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.078499 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.248499 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:42.257314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-20bd7d57-4949-4edd-b85b-304f76e15ca0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.207514 Aug 31 04:41:42.257899 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 432/910] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:42 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:42.394085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b4dac11-6526-4e03-99dc-80639e1061ff"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:42.398019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:42.404445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.404993 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.405652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.406351 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.406812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.407444 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.422016 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:42.478954 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-04adda90-967e-43f2-98bb-b890121d109f req-ce512d71-8f4c-4225-af0d-718de2075503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff76b8-6b3d-47fc-9e88-95c76e7bd11f", "name": "network-vif-plugged", "status": "completed", "tag": "e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:42.489874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-04adda90-967e-43f2-98bb-b890121d109f req-ce512d71-8f4c-4225-af0d-718de2075503 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.490736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-04adda90-967e-43f2-98bb-b890121d109f req-ce512d71-8f4c-4225-af0d-718de2075503 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.491535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-04adda90-967e-43f2-98bb-b890121d109f req-ce512d71-8f4c-4225-af0d-718de2075503 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.504328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-04adda90-967e-43f2-98bb-b890121d109f req-ce512d71-8f4c-4225-af0d-718de2075503 service nova] Creating event network-vif-plugged:e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8 for instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f on hv-cinder-85530 Aug 31 04:41:42.509679 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-04adda90-967e-43f2-98bb-b890121d109f req-ce512d71-8f4c-4225-af0d-718de2075503 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Aug 31 04:41:42.510360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 433/911] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:41:42.698558 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:42.699365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:42.706334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.706842 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.707421 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.708125 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.708853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.709615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.715307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b6703845-526e-4059-a99e-ceb5acad0ebe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324812 Aug 31 04:41:42.715934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 479/912] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:41:42 2022] POST /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:42.893200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:42.903353 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:42.905639 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:42.907080 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e512da2b-8027-4f75-a5e8-39d3dad5f0bd tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.213690 Aug 31 04:41:42.921311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:42.922451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:42.922611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 434/913] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:42 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:41:42.929348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.929825 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.930245 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.930978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:42.931406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:42.931820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:42.948469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] HTTP exception thrown: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Request method failure captured: Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 HTTP/1.1 Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTtCMmQD-tV0wzwcagU0VgHu5uLpWfLkeBFOT9yaL97mfDFUIASWen32QeUE-o19IuOe8vt9s5j_bEbcJW9MsTraI_t2SyZTx9O7CDUNm10-O1cRQACk6F8klq9n5p7HKeP9pxWE4kdBVxmbe8odMLrbuQ308NrfmGbsJDEHIdJS3Q Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:41:42.950130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94afda48b8e545dfaeac33a66f592fe2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}] Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 718418f954f94dad93eeb725e345c850 Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:42.951743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '9472a4bc-d255-45a5-a6b0-016a1bd62606'} Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:42.952590 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:42.953841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:42.954982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Returning 404 to user: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:42.954982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d49c7181-ab2c-4d2a-bc8d-107208eb4a67 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 404 len: 111 microversion: 2.1 time: 0.034555 Aug 31 04:41:42.954982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 480/914] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:42 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:41:42.960805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b391a3c2-2e9e-45fd-b2d5-b5689692412f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '.version_select at 0x7fc826fd7e50>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:42.981154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b391a3c2-2e9e-45fd-b2d5-b5689692412f tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428226973" status: 202 len: 0 microversion: 2.1 time: 0.024222 Aug 31 04:41:42.981754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 435/915] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 31 04:41:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428226973 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:41:43.277726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:43.278701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:43.285578 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:43.286053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:43.286482 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:43.287423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:43.287885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:43.288295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:43.501673 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:43.509861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f8a5be6e-745c-48f8-b41d-0f765871e7ac tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.235969 Aug 31 04:41:43.510508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 481/916] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:43 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:43.933749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:43.934645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:43.943603 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:43.944163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:43.944606 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:43.945311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:43.945761 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:43.946174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:44.098113 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:44.107034 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:44.108804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:44.109973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-928f8920-71f2-4d94-9cdd-06fe4829663e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1729 microversion: 2.20 time: 0.182860 Aug 31 04:41:44.110525 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 436/917] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:43 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:44.533896 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:44.534520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:44.543379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:44.543863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:44.544286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:44.545009 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:44.545451 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:44.545866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:44.695423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:44.704052 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-764ca361-2b8e-4b35-a1a1-17418360311f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.175670 Aug 31 04:41:44.704621 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 482/918] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:44 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:45.136334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:45.136914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:45.144621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:45.145072 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:45.145486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:45.146365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:45.146900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:45.147318 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:45.298590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:45.307325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:45.308737 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:45.309933 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-10453cef-bb3d-4404-bf13-cffa6206c38f tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1716 microversion: 2.20 time: 0.178452 Aug 31 04:41:45.310513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 437/919] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:41:45 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1716 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:41:45.729068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:45.729649 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:45.738901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:45.739384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:45.739789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:45.740578 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:45.741054 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:45.741440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:45.880682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:45.888565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ef69abbd-721d-42c6-a94e-7f893ad95026 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.166153 Aug 31 04:41:45.889142 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 483/920] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:45 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:45.970190 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:45.970690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:45.977052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:45.977540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:45.977974 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:45.978669 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:45.979333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:45.979700 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:45.994179 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] HTTP exception thrown: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Request method failure captured: Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 HTTP/1.1 Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTtCMmQD-tV0wzwcagU0VgHu5uLpWfLkeBFOT9yaL97mfDFUIASWen32QeUE-o19IuOe8vt9s5j_bEbcJW9MsTraI_t2SyZTx9O7CDUNm10-O1cRQACk6F8klq9n5p7HKeP9pxWE4kdBVxmbe8odMLrbuQ308NrfmGbsJDEHIdJS3Q Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:41:45.995956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94afda48b8e545dfaeac33a66f592fe2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}] Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 718418f954f94dad93eeb725e345c850 Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:45.997384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '9472a4bc-d255-45a5-a6b0-016a1bd62606'} Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:45.998262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:45.999745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:46.001431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Returning 404 to user: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:46.001431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-064c644e-e3fd-4c51-b4ff-09568f10cc9d tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 404 len: 111 microversion: 2.1 time: 0.031062 Aug 31 04:41:46.001431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 438/921] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:41:45 2022] DELETE /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:41:46.007222 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:46.007853 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 9472a4bc-d255-45a5-a6b0-016a1bd62606] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:46.013889 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:46.014367 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:46.014830 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:46.015615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:46.016040 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:46.016487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:46.029741 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] HTTP exception thrown: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Request method failure captured: Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 HTTP/1.1 Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTtCMmQD-tV0wzwcagU0VgHu5uLpWfLkeBFOT9yaL97mfDFUIASWen32QeUE-o19IuOe8vt9s5j_bEbcJW9MsTraI_t2SyZTx9O7CDUNm10-O1cRQACk6F8klq9n5p7HKeP9pxWE4kdBVxmbe8odMLrbuQ308NrfmGbsJDEHIdJS3Q Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:41:46.031306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94afda48b8e545dfaeac33a66f592fe2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}] Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 718418f954f94dad93eeb725e345c850 Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:46.032871 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '9472a4bc-d255-45a5-a6b0-016a1bd62606'} Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:46.033653 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. Aug 31 04:41:46.035068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:46.036348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Returning 404 to user: Instance 9472a4bc-d255-45a5-a6b0-016a1bd62606 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:46.036348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6dd8b7d2-ae38-43bd-8fc8-956c1c118add tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606" status: 404 len: 111 microversion: 2.1 time: 0.030725 Aug 31 04:41:46.036348 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 484/922] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:46 2022] GET /compute/v2.1/servers/9472a4bc-d255-45a5-a6b0-016a1bd62606 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:41:46.918117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:46.919156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:46.929873 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:46.930562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:46.931160 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:46.931999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:46.932592 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:46.933201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:47.066972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:47.075757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c791267f-880e-4f7f-b6be-b6c3645b2592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.164230 Aug 31 04:41:47.076360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 439/923] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:46 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:47.175761 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:47.176274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:47.182945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:47.183425 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:47.183839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:47.184557 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:47.185000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:47.185416 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:47.199133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] HTTP exception thrown: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Request method failure captured: Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 HTTP/1.1 Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTtCMmQD-tV0wzwcagU0VgHu5uLpWfLkeBFOT9yaL97mfDFUIASWen32QeUE-o19IuOe8vt9s5j_bEbcJW9MsTraI_t2SyZTx9O7CDUNm10-O1cRQACk6F8klq9n5p7HKeP9pxWE4kdBVxmbe8odMLrbuQ308NrfmGbsJDEHIdJS3Q Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:41:47.200665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94afda48b8e545dfaeac33a66f592fe2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}] Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 718418f954f94dad93eeb725e345c850 Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.202179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '37d80f26-ed89-466a-8716-08e48aa7dfb8'} Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:47.203098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.204374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.205693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Returning 404 to user: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:47.205693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-65f92376-9f13-473f-90a7-89da0e3ff0e3 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 404 len: 111 microversion: 2.1 time: 0.030259 Aug 31 04:41:47.205693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 485/924] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:41:47 2022] DELETE /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:41:47.211181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:47.211793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] [instance: 37d80f26-ed89-466a-8716-08e48aa7dfb8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:47.218382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:47.218890 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:47.219322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:47.220037 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:47.220481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:47.220896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:47.234903 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] HTTP exception thrown: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Request method failure captured: Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 HTTP/1.1 Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTtCMmQD-tV0wzwcagU0VgHu5uLpWfLkeBFOT9yaL97mfDFUIASWen32QeUE-o19IuOe8vt9s5j_bEbcJW9MsTraI_t2SyZTx9O7CDUNm10-O1cRQACk6F8klq9n5p7HKeP9pxWE4kdBVxmbe8odMLrbuQ308NrfmGbsJDEHIdJS3Q Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:41:47.236419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_94afda48b8e545dfaeac33a66f592fe2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/94afda48b8e545dfaeac33a66f592fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/94afda48b8e545dfaeac33a66f592fe2"}]}] Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 94afda48b8e545dfaeac33a66f592fe2 Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-795572611 Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 718418f954f94dad93eeb725e345c850 Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-795572611-project Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.237865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '37d80f26-ed89-466a-8716-08e48aa7dfb8'} Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:47.238698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. Aug 31 04:41:47.240106 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:47.241444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] Returning 404 to user: Instance 37d80f26-ed89-466a-8716-08e48aa7dfb8 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:47.241444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f0def339-9568-4875-bcc6-ea212d99c7f2 tempest-AttachVolumeTestJSON-795572611 tempest-AttachVolumeTestJSON-795572611-project] 10.222.0.42 "GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8" status: 404 len: 111 microversion: 2.1 time: 0.030636 Aug 31 04:41:47.241444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 440/925] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:47 2022] GET /compute/v2.1/servers/37d80f26-ed89-466a-8716-08e48aa7dfb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:41:48.102975 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:48.103587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:48.110065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:48.110539 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:48.111171 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:48.111863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:48.112303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:48.112927 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:48.329773 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:48.340572 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6f747bab-3784-49e6-a3d2-9336e9526607 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.241806 Aug 31 04:41:48.341637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 486/926] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:48 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:49.364017 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:49.364411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:49.371247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:49.372295 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:49.372993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:49.373716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:49.374395 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:49.374993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:49.587434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:49.595410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b61e1355-26be-4e75-a924-cb1ce4d8c0bb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.237646 Aug 31 04:41:49.596302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 441/927] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:49 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:50.295465 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0bf62a82-5220-4703-a415-ef0fba986a74 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: .version_select at 0x7fc82a811820>, body: {"keypair": {"name": "tempest-keypair-1458399085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRo4/7xplz1vAi0XWy0cDfxP0NscK+XWYVMbrOtslU7+hEXgY7ygFxKpvKEnsSjbdnU0pwGR1btVOaxciuy2XNXuSwXzvEtrS3CJUfGQgAAjM55ZhVeZ39YaLCH40P9DA=="}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:50.314762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-0bf62a82-5220-4703-a415-ef0fba986a74 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:41:50.318602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-0bf62a82-5220-4703-a415-ef0fba986a74 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:41:50.360541 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0bf62a82-5220-4703-a415-ef0fba986a74 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068900 Aug 31 04:41:50.368623 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 487/928] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:41:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:50.462823 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-37b03be8-e059-4a42-98eb-aad1beab5dc8 req-7aaabba7-b314-46f1-8ab3-356750eb0b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1083f879-d1a1-4430-8b82-35a8833d029d", "name": "network-vif-plugged", "status": "completed", "tag": "6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:50.482684 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-37b03be8-e059-4a42-98eb-aad1beab5dc8 req-7aaabba7-b314-46f1-8ab3-356750eb0b8e service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:50.483592 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-37b03be8-e059-4a42-98eb-aad1beab5dc8 req-7aaabba7-b314-46f1-8ab3-356750eb0b8e service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:50.484194 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-37b03be8-e059-4a42-98eb-aad1beab5dc8 req-7aaabba7-b314-46f1-8ab3-356750eb0b8e service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:50.522348 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-37b03be8-e059-4a42-98eb-aad1beab5dc8 req-7aaabba7-b314-46f1-8ab3-356750eb0b8e service nova] Creating event network-vif-plugged:6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae for instance 1083f879-d1a1-4430-8b82-35a8833d029d on hv-cinder-85530 Aug 31 04:41:50.539013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-37b03be8-e059-4a42-98eb-aad1beab5dc8 req-7aaabba7-b314-46f1-8ab3-356750eb0b8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082117 Aug 31 04:41:50.539013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 442/929] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:50.617285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:50.621842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:50.628556 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:50.629601 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:50.630559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:50.631381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:50.632316 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:50.632809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:50.864058 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:50.873495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d6fdd8b6-1c9e-4d67-a6f2-a2e9ae23954e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.260143 Aug 31 04:41:50.887036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 488/930] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:50 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:51.893994 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:51.894685 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:51.902068 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:51.902534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:51.903203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:51.903900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:51.904348 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:51.904767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:52.087348 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:52.101416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b1ba355a-686f-47f5-8ac5-de163ec276a4 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1267 microversion: 2.1 time: 0.211521 Aug 31 04:41:52.102364 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 443/931] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:51 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:52.168242 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310040046", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5e1d21-0d94-4325-a39c-d7a84e70a79f"}], "security_groups": [{"name": "tempest-securitygroup--1082116864"}], "key_name": "tempest-keypair-1458399085", "user_data": "}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:52.432727 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] validate_networks() for [('9f5e1d21-0d94-4325-a39c-d7a84e70a79f', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:41:52.456395 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a928545c-6a64-4601-ac62-bccd3f6a5342 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Action: 'create', calling method: .version_select at 0x7fc826fc8c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-781647611", "metadata": {"Type": "work"}}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:52.754032 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a928545c-6a64-4601-ac62-bccd3f6a5342 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.489986 Aug 31 04:41:52.762244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 444/932] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 04:41:52 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 499 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 31 04:41:52.767360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3ac634ba-e018-486c-8d7b-fad7ffe5bb2a tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Calling method '.version_select at 0x7fc82708a1f0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:52.823258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3ac634ba-e018-486c-8d7b-fad7ffe5bb2a tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336" status: 200 len: 352 microversion: 2.1 time: 0.059796 Aug 31 04:41:52.823846 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 445/933] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:41:52 2022] GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:52.829995 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:41:52.830406 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:41:52.830914 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:41:52.831433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:41:52.831833 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:41:52.840738 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:52.841199 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:52.841617 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:52.842318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:52.842856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:52.843269 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:52.860314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:41:52.864170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:41:52.873002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:52.875649 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:41:52.877946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:41:52.923960 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a615ac01-3f83-4c17-ada5-330c80a82951 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.759973 Aug 31 04:41:52.924585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 489/934] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:41:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:41:52.936223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f9e11b10-8bf1-4574-976c-35a87d650e8d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:52.936845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f9e11b10-8bf1-4574-976c-35a87d650e8d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:52.994680 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f9e11b10-8bf1-4574-976c-35a87d650e8d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:53.003135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f9e11b10-8bf1-4574-976c-35a87d650e8d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1241 microversion: 2.1 time: 0.071332 Aug 31 04:41:53.003713 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 446/935] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:52 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:53.123139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:53.123724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:53.130807 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:53.131448 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:53.131933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:53.132813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:53.133350 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:53.134012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:53.275281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:53.284956 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-95d1b3f8-b8df-4672-bdb6-06cdb0d1f6bf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1454 microversion: 2.1 time: 0.166008 Aug 31 04:41:53.285743 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 490/936] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:53 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:53.305748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:53.306272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:53.312331 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:53.312809 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:53.313233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:53.313931 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:53.314367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:53.314816 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:53.318900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:53.452044 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:53.460480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c7ae4527-6de4-4b9e-a973-e99f2b5bd318 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1454 microversion: 2.1 time: 0.158720 Aug 31 04:41:53.461338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 447/937] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:53 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:53.838628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d0754ba2-8d05-467a-a9cd-f603c15cae12 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Calling method '.version_select at 0x7fc82a86fc10>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:53.888072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d0754ba2-8d05-467a-a9cd-f603c15cae12 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336" status: 200 len: 353 microversion: 2.1 time: 0.054159 Aug 31 04:41:53.888796 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 491/938] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:41:53 2022] GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:53.901385 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-68af365d-0937-4254-836b-f582f58504b9 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Calling method '.version_select at 0x7fc826fc8430>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:53.949683 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-68af365d-0937-4254-836b-f582f58504b9 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336" status: 200 len: 353 microversion: 2.1 time: 0.052234 Aug 31 04:41:53.950265 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 448/939] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:41:53 2022] GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:53.963001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-efe01983-6cf1-4c11-a036-cb31638c901e tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Calling method '.version_select at 0x7fc82a86f160>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:54.024112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:54.024866 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:54.027614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-efe01983-6cf1-4c11-a036-cb31638c901e tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336" status: 202 len: 0 microversion: 2.1 time: 0.068390 Aug 31 04:41:54.028400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 492/940] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:41:53 2022] DELETE /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:41:54.031574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:54.032054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:54.032482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:54.033175 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:54.033617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:54.034083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:54.036945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b6c3a1a4-a695-4700-b7c6-05cbf4ca12d1 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Calling method '.version_select at 0x7fc82a852160>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:54.104861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:54.114334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ba72c256-423a-4ab4-8a54-9fe10c7a7c5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1293 microversion: 2.1 time: 0.094383 Aug 31 04:41:54.114940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b6c3a1a4-a695-4700-b7c6-05cbf4ca12d1 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336" status: 200 len: 352 microversion: 2.1 time: 0.082329 Aug 31 04:41:54.121125 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 449/941] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:54 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:41:54.121408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 493/942] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:41:54 2022] GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336 => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:55.129151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a5374b3e-1050-4566-b161-4ed95b8a57c9 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Calling method '.version_select at 0x7fc826f44dc0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:55.139844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:55.146665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:55.155019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:55.156160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:55.157111 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:55.158242 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:55.159077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:55.159708 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:55.166307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-a5374b3e-1050-4566-b161-4ed95b8a57c9 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] HTTP exception thrown: Volume 657109e2-7fae-47ff-8b37-cb0ff9049336 could not be found. Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a5374b3e-1050-4566-b161-4ed95b8a57c9 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Request method failure captured: Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336 HTTP/1.1 Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuaQaQ8qfdrvmvJahYUS716p65TLFc8pff5VK6gW9KFjBVv0iugJIlkjzFhHzcrm4sEtjbsIbaYBhdD5oNp53DGya3q9sqMJYv62UgsaJjTXHvB8u0i5yBdB3N4nKDYbK_Q0aHKBMIJGkwUQoNO-JvwtDEUvFf8UNwq2_o6pY39as6w Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: bd6a276a007c4dce92019fffbc54c80a Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesGetTestJSON-1172963677 Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:41:55.176480 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bd6a276a007c4dce92019fffbc54c80a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bd6a276a007c4dce92019fffbc54c80a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bd6a276a007c4dce92019fffbc54c80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bd6a276a007c4dce92019fffbc54c80a"}]}] Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesGetTestJSON-1172963677 Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: bd6a276a007c4dce92019fffbc54c80a Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesGetTestJSON-1172963677 Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesGetTestJSON-1172963677-project Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: aa7eb8e35a114c1c97f9ba9851126882 Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesGetTestJSON-1172963677-project Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Volume 657109e2-7fae-47ff-8b37-cb0ff9049336 could not be found. Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '657109e2-7fae-47ff-8b37-cb0ff9049336'} Aug 31 04:41:55.178119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 657109e2-7fae-47ff-8b37-cb0ff9049336 could not be found. (HTTP 404) (Request-ID: req-3ae4d59e-740d-458d-b351-d710f9d644f6) Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:55.179828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:41:55.181827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 657109e2-7fae-47ff-8b37-cb0ff9049336 could not be found. Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:41:55.183212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 657109e2-7fae-47ff-8b37-cb0ff9049336 could not be found. Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 657109e2-7fae-47ff-8b37-cb0ff9049336 could not be found. Aug 31 04:41:55.184699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:55.186885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a5374b3e-1050-4566-b161-4ed95b8a57c9 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] Returning 404 to user: Volume 657109e2-7fae-47ff-8b37-cb0ff9049336 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:55.188039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a5374b3e-1050-4566-b161-4ed95b8a57c9 tempest-VolumesGetTestJSON-1172963677 tempest-VolumesGetTestJSON-1172963677-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336" status: 404 len: 109 microversion: 2.1 time: 0.062935 Aug 31 04:41:55.189321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 450/943] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:41:55 2022] GET /compute/v2.1/os-volumes/657109e2-7fae-47ff-8b37-cb0ff9049336 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:41:55.312137 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:55.322890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6048000f-7a3f-47aa-a0ff-0bcf20fe7344 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1299 microversion: 2.1 time: 0.190878 Aug 31 04:41:55.323994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 494/944] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:55 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1299 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:55.633518 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-5db4d1b6-07f4-47cf-8bf2-d84f6ff7dae6 req-b21f9ee1-ee79-482a-a096-33430219b782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1083f879-d1a1-4430-8b82-35a8833d029d", "tag": "6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:55.648674 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5db4d1b6-07f4-47cf-8bf2-d84f6ff7dae6 req-b21f9ee1-ee79-482a-a096-33430219b782 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:55.649153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5db4d1b6-07f4-47cf-8bf2-d84f6ff7dae6 req-b21f9ee1-ee79-482a-a096-33430219b782 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:55.649651 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5db4d1b6-07f4-47cf-8bf2-d84f6ff7dae6 req-b21f9ee1-ee79-482a-a096-33430219b782 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:55.661412 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-5db4d1b6-07f4-47cf-8bf2-d84f6ff7dae6 req-b21f9ee1-ee79-482a-a096-33430219b782 service nova] Creating event network-changed:6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae for instance 1083f879-d1a1-4430-8b82-35a8833d029d on hv-cinder-85530 Aug 31 04:41:55.673357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-5db4d1b6-07f4-47cf-8bf2-d84f6ff7dae6 req-b21f9ee1-ee79-482a-a096-33430219b782 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043746 Aug 31 04:41:55.675625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 451/945] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:41:56.345387 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:56.346995 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:56.358047 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:56.358989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:56.359476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:56.360366 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:56.360867 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:56.361453 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:56.533498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:56.544725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-02fe5052-b58f-491d-ac6b-f1d807cd232e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1367 microversion: 2.1 time: 0.202852 Aug 31 04:41:56.545194 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 495/946] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:56 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:56.864295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-c97c36bc-5795-4eb1-bb9e-20eae6e3b284 req-795f509b-6b68-4303-af64-06787e615e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb58876-fcb0-48d7-a852-830fb79567ea", "tag": "43245827-8072-4b30-b574-8f9a4e99070a"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:56.875082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c97c36bc-5795-4eb1-bb9e-20eae6e3b284 req-795f509b-6b68-4303-af64-06787e615e1b service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:56.875504 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c97c36bc-5795-4eb1-bb9e-20eae6e3b284 req-795f509b-6b68-4303-af64-06787e615e1b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:56.875920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c97c36bc-5795-4eb1-bb9e-20eae6e3b284 req-795f509b-6b68-4303-af64-06787e615e1b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:56.891060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-c97c36bc-5795-4eb1-bb9e-20eae6e3b284 req-795f509b-6b68-4303-af64-06787e615e1b service nova] Creating event network-changed:43245827-8072-4b30-b574-8f9a4e99070a for instance abb58876-fcb0-48d7-a852-830fb79567ea on hv-cinder-85530 Aug 31 04:41:56.895786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-c97c36bc-5795-4eb1-bb9e-20eae6e3b284 req-795f509b-6b68-4303-af64-06787e615e1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035293 Aug 31 04:41:56.896911 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 496/947] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:41:56.967279 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d0c09f8-f3de-465a-be0c-41a46200370f tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Action: 'create', calling method: .version_select at 0x7fc826fc8f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-573787076", "metadata": {"Type": "work"}}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d0c09f8-f3de-465a-be0c-41a46200370f tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Request method failure captured: Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 121 Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuaU9jEw7zhpQrKSc7sHq1SxAMk8svIys7pUvF51zkdeyvPbCiNzzgz8oPF7v21jtwqhOQZOyUwMf2LpZaVd4Z6p96FBaKZ8fM58yxdefkOU8xErSMhh8xSUKlAI0rIcfpNBPN5RUkhYKKSUR0avpbi1t3hzAi4IOJnYRiJ3V1-SjDA Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:41:56.979517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_640529f2263b41b7aca6944eec599c8e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}] Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: c5aef741693d4bceb88359b6b6f4815d Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-573787076", "metadata": {"Type": "work"}}} Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: Aug 31 04:41:56.981066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-573787076', 'metadata': {'Type': 'work'}}}} Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise error Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:56.982221 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 04:41:56.984178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 04:41:56.985487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 04:41:56.985487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.985487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d0c09f8-f3de-465a-be0c-41a46200370f tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:56.985487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d0c09f8-f3de-465a-be0c-41a46200370f tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.166800 Aug 31 04:41:56.985487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 452/948] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 04:41:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:41:56.992113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-67250d29-415a-41a1-8bbf-dc711bfd83f2 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Action: 'create', calling method: .version_select at 0x7fc82a88d700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-859641847", "metadata": {"Type": "work"}}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-67250d29-415a-41a1-8bbf-dc711bfd83f2 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Request method failure captured: Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 119 Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuaU9jEw7zhpQrKSc7sHq1SxAMk8svIys7pUvF51zkdeyvPbCiNzzgz8oPF7v21jtwqhOQZOyUwMf2LpZaVd4Z6p96FBaKZ8fM58yxdefkOU8xErSMhh8xSUKlAI0rIcfpNBPN5RUkhYKKSUR0avpbi1t3hzAi4IOJnYRiJ3V1-SjDA Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:41:56.996814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_640529f2263b41b7aca6944eec599c8e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}] Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: c5aef741693d4bceb88359b6b6f4815d Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-859641847", "metadata": {"Type": "work"}}} Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: Aug 31 04:41:56.998411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-859641847', 'metadata': {'Type': 'work'}}}} Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise error Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi '0' Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:56.999459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 04:41:57.000994 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 04:41:57.002156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 04:41:57.002156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.002156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-67250d29-415a-41a1-8bbf-dc711bfd83f2 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:57.002156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-67250d29-415a-41a1-8bbf-dc711bfd83f2 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010863 Aug 31 04:41:57.002156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 497/949] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 04:41:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:41:57.007921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f6011e25-b6fe-42ce-a157-82e8a2ec51aa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Action: 'create', calling method: .version_select at 0x7fc8270c9af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-846763506", "metadata": {"Type": "work"}}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f6011e25-b6fe-42ce-a157-82e8a2ec51aa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Request method failure captured: Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 118 Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuaU9jEw7zhpQrKSc7sHq1SxAMk8svIys7pUvF51zkdeyvPbCiNzzgz8oPF7v21jtwqhOQZOyUwMf2LpZaVd4Z6p96FBaKZ8fM58yxdefkOU8xErSMhh8xSUKlAI0rIcfpNBPN5RUkhYKKSUR0avpbi1t3hzAi4IOJnYRiJ3V1-SjDA Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:41:57.012380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_640529f2263b41b7aca6944eec599c8e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}] Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: c5aef741693d4bceb88359b6b6f4815d Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-846763506", "metadata": {"Type": "work"}}} Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: Aug 31 04:41:57.013941 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-846763506', 'metadata': {'Type': 'work'}}}} Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise error Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi '' Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:57.015441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 04:41:57.016916 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 04:41:57.018628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 04:41:57.018628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.018628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f6011e25-b6fe-42ce-a157-82e8a2ec51aa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:57.018628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f6011e25-b6fe-42ce-a157-82e8a2ec51aa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009850 Aug 31 04:41:57.018628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 453/950] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 31 04:41:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:41:57.023609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-91b1f14e-4839-4664-8f98-7e9b4b31bafa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Calling method '.version_select at 0x7fc82a852040>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:57.052422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-91b1f14e-4839-4664-8f98-7e9b4b31bafa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] HTTP exception thrown: Volume tempest-invalid-434912255 could not be found. Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-91b1f14e-4839-4664-8f98-7e9b4b31bafa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Request method failure captured: Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-434912255 HTTP/1.1 Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuaU9jEw7zhpQrKSc7sHq1SxAMk8svIys7pUvF51zkdeyvPbCiNzzgz8oPF7v21jtwqhOQZOyUwMf2LpZaVd4Z6p96FBaKZ8fM58yxdefkOU8xErSMhh8xSUKlAI0rIcfpNBPN5RUkhYKKSUR0avpbi1t3hzAi4IOJnYRiJ3V1-SjDA Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:41:57.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_640529f2263b41b7aca6944eec599c8e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}] Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: c5aef741693d4bceb88359b6b6f4815d Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Volume tempest-invalid-434912255 could not be found. Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': 'tempest-invalid-434912255'} Aug 31 04:41:57.057234 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-434912255 could not be found. (HTTP 404) (Request-ID: req-02945466-4ea8-4a6c-8ca4-3435383d37cd) Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.058156 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:41:57.059570 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-434912255 could not be found. Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:57.060844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-434912255 could not be found. Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-434912255 could not be found. Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-91b1f14e-4839-4664-8f98-7e9b4b31bafa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Returning 404 to user: Volume tempest-invalid-434912255 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-91b1f14e-4839-4664-8f98-7e9b4b31bafa tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-434912255" status: 404 len: 98 microversion: 2.1 time: 0.037634 Aug 31 04:41:57.062042 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 498/951] 10.222.0.42 () {58 vars in 1215 bytes} [Wed Aug 31 04:41:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-434912255 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 04:41:57.068729 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fe5f4094-dfbe-4064-add5-ebf27ef76354 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003739 Aug 31 04:41:57.073918 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 454/952] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 31 04:41:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 04:41:57.079024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2d69c128-7a78-4972-b082-3c5131027354 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003835 Aug 31 04:41:57.079528 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 499/953] 10.222.0.42 () {58 vars in 1137 bytes} [Wed Aug 31 04:41:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 04:41:57.088574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-556493d7-7efe-478b-971f-175b881dd874 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Calling method '.version_select at 0x7fc826fc8820>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:57.124283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-556493d7-7efe-478b-971f-175b881dd874 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] HTTP exception thrown: Volume 7f807b08-be54-4b37-8c3c-3afcde874343 could not be found. Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-556493d7-7efe-478b-971f-175b881dd874 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Request method failure captured: Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/os-volumes/7f807b08-be54-4b37-8c3c-3afcde874343 HTTP/1.1 Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuaU9jEw7zhpQrKSc7sHq1SxAMk8svIys7pUvF51zkdeyvPbCiNzzgz8oPF7v21jtwqhOQZOyUwMf2LpZaVd4Z6p96FBaKZ8fM58yxdefkOU8xErSMhh8xSUKlAI0rIcfpNBPN5RUkhYKKSUR0avpbi1t3hzAi4IOJnYRiJ3V1-SjDA Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:41:57.126382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_640529f2263b41b7aca6944eec599c8e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}] Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: c5aef741693d4bceb88359b6b6f4815d Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Volume 7f807b08-be54-4b37-8c3c-3afcde874343 could not be found. Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '7f807b08-be54-4b37-8c3c-3afcde874343'} Aug 31 04:41:57.128309 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f807b08-be54-4b37-8c3c-3afcde874343 could not be found. (HTTP 404) (Request-ID: req-b5e61722-a0bf-494e-b532-5ccf6181e14d) Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.129345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:41:57.131891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f807b08-be54-4b37-8c3c-3afcde874343 could not be found. Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 04:41:57.134975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f807b08-be54-4b37-8c3c-3afcde874343 could not be found. Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f807b08-be54-4b37-8c3c-3afcde874343 could not be found. Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-556493d7-7efe-478b-971f-175b881dd874 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Returning 404 to user: Volume 7f807b08-be54-4b37-8c3c-3afcde874343 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-556493d7-7efe-478b-971f-175b881dd874 tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7f807b08-be54-4b37-8c3c-3afcde874343" status: 404 len: 109 microversion: 2.1 time: 0.044343 Aug 31 04:41:57.136927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 455/954] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:41:57 2022] DELETE /compute/v2.1/os-volumes/7f807b08-be54-4b37-8c3c-3afcde874343 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:41:57.138820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9d6e93f6-f29c-42a0-ab66-6dcb35b260fc tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Calling method '.version_select at 0x7fc82a81bca0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:57.166664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-9d6e93f6-f29c-42a0-ab66-6dcb35b260fc tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] HTTP exception thrown: Volume 3e7509a1-159c-4884-8fd9-baa744a2353d could not be found. Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9d6e93f6-f29c-42a0-ab66-6dcb35b260fc tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Request method failure captured: Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/os-volumes/3e7509a1-159c-4884-8fd9-baa744a2353d HTTP/1.1 Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuaU9jEw7zhpQrKSc7sHq1SxAMk8svIys7pUvF51zkdeyvPbCiNzzgz8oPF7v21jtwqhOQZOyUwMf2LpZaVd4Z6p96FBaKZ8fM58yxdefkOU8xErSMhh8xSUKlAI0rIcfpNBPN5RUkhYKKSUR0avpbi1t3hzAi4IOJnYRiJ3V1-SjDA Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:41:57.168724 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_640529f2263b41b7aca6944eec599c8e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/640529f2263b41b7aca6944eec599c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/640529f2263b41b7aca6944eec599c8e"}]}] Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 640529f2263b41b7aca6944eec599c8e Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-VolumesNegativeTest-1357627989 Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: c5aef741693d4bceb88359b6b6f4815d Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-VolumesNegativeTest-1357627989-project Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Volume 3e7509a1-159c-4884-8fd9-baa744a2353d could not be found. Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '3e7509a1-159c-4884-8fd9-baa744a2353d'} Aug 31 04:41:57.170297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e7509a1-159c-4884-8fd9-baa744a2353d could not be found. (HTTP 404) (Request-ID: req-c8430d51-0afc-4372-9a44-c7eee2842171) Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.171839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:41:57.173219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e7509a1-159c-4884-8fd9-baa744a2353d could not be found. Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:41:57.174420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e7509a1-159c-4884-8fd9-baa744a2353d could not be found. Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e7509a1-159c-4884-8fd9-baa744a2353d could not be found. Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9d6e93f6-f29c-42a0-ab66-6dcb35b260fc tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] Returning 404 to user: Volume 3e7509a1-159c-4884-8fd9-baa744a2353d could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9d6e93f6-f29c-42a0-ab66-6dcb35b260fc tempest-VolumesNegativeTest-1357627989 tempest-VolumesNegativeTest-1357627989-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3e7509a1-159c-4884-8fd9-baa744a2353d" status: 404 len: 109 microversion: 2.1 time: 0.035331 Aug 31 04:41:57.175639 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 500/955] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:41:57 2022] GET /compute/v2.1/os-volumes/3e7509a1-159c-4884-8fd9-baa744a2353d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:41:57.566244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:57.566993 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:57.573909 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:57.574378 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:57.574834 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:57.575609 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:57.576047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:57.576446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:57.764337 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:57.773399 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7a77c55d-3c09-404d-a6fc-07a90a261bcd tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1367 microversion: 2.1 time: 0.211539 Aug 31 04:41:57.773904 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 456/956] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:57 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:58.795275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:58.796094 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:58.806088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:58.806641 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:58.807144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:58.807906 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:58.808421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:58.808922 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:58.943950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:41:58.951905 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-dee04849-9acd-4e10-b5e1-2139e41cd2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1367 microversion: 2.1 time: 0.162142 Aug 31 04:41:58.952581 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 501/957] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:58 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:41:59.973230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:41:59.973865 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:41:59.980889 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:59.981529 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:59.982182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:41:59.983255 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:41:59.984242 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:41:59.984843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:00.127410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:00.135328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bd7499d8-7b78-4231-9ddc-648403fa05f5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1367 microversion: 2.1 time: 0.166316 Aug 31 04:42:00.135896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 457/958] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:41:59 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:01.156166 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:01.157368 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:01.164092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:01.164566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:01.165079 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:01.165827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:01.166208 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:01.166527 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:01.305495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:01.313170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-da7992cf-4414-40f0-8d18-d612926c90ef tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1367 microversion: 2.1 time: 0.160949 Aug 31 04:42:01.313731 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 502/959] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:01 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:02.333365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:02.333968 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:02.341631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:02.342241 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:02.342681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:02.343427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:02.343876 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:02.344307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:02.373921 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-bee22151-3b10-4496-be5e-53343a87fc83 req-97be1d36-6c56-499d-8448-9694ac1b4333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb58876-fcb0-48d7-a852-830fb79567ea", "name": "network-vif-plugged", "status": "completed", "tag": "43245827-8072-4b30-b574-8f9a4e99070a"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:02.390893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-bee22151-3b10-4496-be5e-53343a87fc83 req-97be1d36-6c56-499d-8448-9694ac1b4333 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:02.391667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-bee22151-3b10-4496-be5e-53343a87fc83 req-97be1d36-6c56-499d-8448-9694ac1b4333 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:02.392306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-bee22151-3b10-4496-be5e-53343a87fc83 req-97be1d36-6c56-499d-8448-9694ac1b4333 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:02.404794 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-bee22151-3b10-4496-be5e-53343a87fc83 req-97be1d36-6c56-499d-8448-9694ac1b4333 service nova] Creating event network-vif-plugged:43245827-8072-4b30-b574-8f9a4e99070a for instance abb58876-fcb0-48d7-a852-830fb79567ea on hv-cinder-85530 Aug 31 04:42:02.412069 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-bee22151-3b10-4496-be5e-53343a87fc83 req-97be1d36-6c56-499d-8448-9694ac1b4333 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042401 Aug 31 04:42:02.413463 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 503/960] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:02.493820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:02.501842 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-af768f32-79e9-43ca-be97-68e955d7bac6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1367 microversion: 2.1 time: 0.172322 Aug 31 04:42:02.502622 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 458/961] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:02 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:03.523638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:03.524345 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:03.526495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:03.527515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=10 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:03.533688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:03.534253 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:03.534866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:03.535760 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:03.536335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:03.536821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:03.672492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:03.682522 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-70269571-f18d-4250-8726-3ea85e11d618 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1367 microversion: 2.1 time: 0.163072 Aug 31 04:42:03.683297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 504/962] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:03 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:04.703738 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:04.704330 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:04.706352 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:04.712482 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:04.712956 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:04.713411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:04.714096 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:04.714534 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:04.714963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:04.851495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:04.860114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ad7d86a5-c83c-4632-bb15-2b29650ce20f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1558 microversion: 2.1 time: 0.160253 Aug 31 04:42:04.860723 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 459/963] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:04 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:04.884628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:04.885333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:04.891759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:04.892352 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:04.892753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:04.893466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:04.893920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:04.894332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:04.978279 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a59e2326-c807-4162-9811-951cfff579be tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098175 Aug 31 04:42:04.978939 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 505/964] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:42:04 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:42:05.943860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-510b33ac-db8d-400d-9b14-ab142ab31c67 req-b3a1efa5-ef93-478b-b555-0c682751fd1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb58876-fcb0-48d7-a852-830fb79567ea", "tag": "43245827-8072-4b30-b574-8f9a4e99070a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:05.953910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-510b33ac-db8d-400d-9b14-ab142ab31c67 req-b3a1efa5-ef93-478b-b555-0c682751fd1f service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:05.954405 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-510b33ac-db8d-400d-9b14-ab142ab31c67 req-b3a1efa5-ef93-478b-b555-0c682751fd1f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:05.954833 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-510b33ac-db8d-400d-9b14-ab142ab31c67 req-b3a1efa5-ef93-478b-b555-0c682751fd1f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:05.967110 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-510b33ac-db8d-400d-9b14-ab142ab31c67 req-b3a1efa5-ef93-478b-b555-0c682751fd1f service nova] Creating event network-changed:43245827-8072-4b30-b574-8f9a4e99070a for instance abb58876-fcb0-48d7-a852-830fb79567ea on hv-cinder-85530 Aug 31 04:42:05.972154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-510b33ac-db8d-400d-9b14-ab142ab31c67 req-b3a1efa5-ef93-478b-b555-0c682751fd1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031948 Aug 31 04:42:05.972961 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 460/965] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:18.583995 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:18.585926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:18.591714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:18.594252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:18.602336 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:18.602931 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:18.603456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:18.604243 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:18.604886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:18.605388 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:18.646072 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1f9670ad-c093-4490-9eb9-5072fe407cf3 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059794 Aug 31 04:42:18.646959 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 506/966] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 31 04:42:18 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:18.725033 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:18.725817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:18.729593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:18.730470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=38 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:18.735467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:18.736023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:18.736610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:18.737525 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:18.738000 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:18.738417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:18.768468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:42:18.874427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a31f08e0-d480-42b2-8c0f-222284430ee7 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 204 len: 0 microversion: 2.20 time: 0.153821 Aug 31 04:42:18.878787 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 461/967] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 04:42:18 2022] DELETE /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:42:18.883652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:18.884254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:18.891848 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:18.892328 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:18.892752 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:18.893614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:18.894059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:18.894637 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:19.051439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:19.060133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:19.070473 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:19.071805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5c6cac5c-f5ec-4f9b-bc11-ecd7432c1990 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.192137 Aug 31 04:42:19.072354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 507/968] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:42:18 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:42:20.095837 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:20.097166 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:20.104227 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:20.104973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:20.105205 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:20.106212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:20.106639 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:20.107276 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:20.357835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:20.367441 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:20.369108 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:20.370606 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1feea1e3-c931-48ea-9c08-88b37d49b5f1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1722 microversion: 2.20 time: 0.279315 Aug 31 04:42:20.371627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 462/969] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:42:20 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:42:21.396933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:21.401282 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:21.417071 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:21.418119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:21.418822 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:21.420106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:21.420812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:21.421493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:21.519816 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:21.536208 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:21.538168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:21.539990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f3d27ff3-6ada-4317-ad84-13a6e45f4276 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1655 microversion: 2.20 time: 0.150177 Aug 31 04:42:21.556887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 508/970] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:42:21 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:42:21.866487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-155a1355-f9d9-4311-94ad-4bec097b0195 req-7338a4b3-7e97-4076-a3f0-09b9459f88e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff76b8-6b3d-47fc-9e88-95c76e7bd11f", "name": "network-vif-deleted", "tag": "e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:21.889832 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-155a1355-f9d9-4311-94ad-4bec097b0195 req-7338a4b3-7e97-4076-a3f0-09b9459f88e9 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:21.890310 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-155a1355-f9d9-4311-94ad-4bec097b0195 req-7338a4b3-7e97-4076-a3f0-09b9459f88e9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:21.890756 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-155a1355-f9d9-4311-94ad-4bec097b0195 req-7338a4b3-7e97-4076-a3f0-09b9459f88e9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:21.914704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-155a1355-f9d9-4311-94ad-4bec097b0195 req-7338a4b3-7e97-4076-a3f0-09b9459f88e9 service nova] Creating event network-vif-deleted:e4da5a6a-dcdf-4c94-ad9e-45d01c35e8f8 for instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f on hv-cinder-85530 Aug 31 04:42:21.920757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-155a1355-f9d9-4311-94ad-4bec097b0195 req-7338a4b3-7e97-4076-a3f0-09b9459f88e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057879 Aug 31 04:42:21.924699 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 463/971] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:22.580971 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:22.582304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:22.597944 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:22.603082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:22.605648 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:22.607336 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:22.613208 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:22.620390 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:22.689618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:22.690373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:22.691013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:22.691635 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lazy-loading 'fault' on Instance uuid 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:42:22.796144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:22.810445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:22.811948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13ac62bdb9bc4c7f94dad08f810559e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd54eb751f144b29b274e6a96dedcb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:22.813191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4d27bc09-92a4-4fe0-bb6e-2f2a31255593 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 200 len: 1370 microversion: 2.20 time: 0.252063 Aug 31 04:42:22.813744 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 509/972] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:42:22 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:42:23.838214 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:23.840536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:23.850964 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:23.851880 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:23.852589 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:23.853500 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:23.854224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:23.855039 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:23.875468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] HTTP exception thrown: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Request method failure captured: Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f HTTP/1.1 Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTqBrCLSgEn8W1iHUKy-E7xU9miySITfwwiiNCzzfQxRRr5sZHorJFSn0t3bhHsTAOjlXvlBA356JbuI0wNXR3oLVeVKRbwC1UYEm9Xgo5WPrmIpItSRITLmeGJKEstwXBLKP82yuy9k_tY1LI_6_oHvc9K2i02F8EBP7L-T0Q8Z8U Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:42:23.877615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bd54eb751f144b29b274e6a96dedcb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}] Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 13ac62bdb9bc4c7f94dad08f810559e9 Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:23.879311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '90ff76b8-6b3d-47fc-9e88-95c76e7bd11f'} Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:23.880133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:23.881972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:23.883460 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Returning 404 to user: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:23.883460 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b89c501a-c7c9-47a7-aebd-28f856789d78 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 404 len: 111 microversion: 2.20 time: 0.046203 Aug 31 04:42:23.888886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8295ca20-8698-4482-8921-fddb484f400e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '.version_select at 0x7fc82a852700>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:23.894297 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 464/973] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:42:23 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:42:23.919036 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8295ca20-8698-4482-8921-fddb484f400e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455379693" status: 204 len: 0 microversion: 2.20 time: 0.033965 Aug 31 04:42:23.923831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 510/974] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Aug 31 04:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455379693 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:42:25.359045 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ea07d64a-9c7a-43a2-8d32-d68c96118ff3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Action: 'create', calling method: .version_select at 0x7fc826fae820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1722327674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqVxIW5zMNM6Pn+d9KL/H2ZrFNbegOrUA/7uMrSCyebXLJvz4zy9EyR2IF9+LMF4lNipf75Cq+WDrF6fSEwqsUxUUzTfpqMfAhALW23QHQIpCTp9VryrtklzRZYBiy95w=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:25.375782 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-ea07d64a-9c7a-43a2-8d32-d68c96118ff3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Getting quotas for project 69713aca5ac144f9bca8348430ab9c75. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:42:25.379711 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-ea07d64a-9c7a-43a2-8d32-d68c96118ff3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Getting quotas for user 81e0524ede63477a9875487d155be25e and project 69713aca5ac144f9bca8348430ab9c75. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:42:25.411391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ea07d64a-9c7a-43a2-8d32-d68c96118ff3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.240104 Aug 31 04:42:25.412174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 465/975] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:42:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:25.999152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:26.000384 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:26.008559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:26.009329 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:26.009910 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:26.010783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:26.011446 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:26.012044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:26.035307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] HTTP exception thrown: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Request method failure captured: Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f HTTP/1.1 Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTqBrCLSgEn8W1iHUKy-E7xU9miySITfwwiiNCzzfQxRRr5sZHorJFSn0t3bhHsTAOjlXvlBA356JbuI0wNXR3oLVeVKRbwC1UYEm9Xgo5WPrmIpItSRITLmeGJKEstwXBLKP82yuy9k_tY1LI_6_oHvc9K2i02F8EBP7L-T0Q8Z8U Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:42:26.037083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bd54eb751f144b29b274e6a96dedcb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}] Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 13ac62bdb9bc4c7f94dad08f810559e9 Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.039115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '90ff76b8-6b3d-47fc-9e88-95c76e7bd11f'} Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:26.039886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.045676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.047174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Returning 404 to user: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:26.047174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-432fe0a5-37ee-41cc-a676-d64fef028e18 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 404 len: 111 microversion: 2.20 time: 0.044038 Aug 31 04:42:26.047174 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 511/976] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 04:42:25 2022] DELETE /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:42:26.048030 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:26.048583 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:26.056888 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:26.057374 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:26.057797 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:26.058708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:26.059182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:26.064663 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:26.088535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] HTTP exception thrown: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Request method failure captured: Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f HTTP/1.1 Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTqBrCLSgEn8W1iHUKy-E7xU9miySITfwwiiNCzzfQxRRr5sZHorJFSn0t3bhHsTAOjlXvlBA356JbuI0wNXR3oLVeVKRbwC1UYEm9Xgo5WPrmIpItSRITLmeGJKEstwXBLKP82yuy9k_tY1LI_6_oHvc9K2i02F8EBP7L-T0Q8Z8U Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:42:26.090238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bd54eb751f144b29b274e6a96dedcb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}] Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 13ac62bdb9bc4c7f94dad08f810559e9 Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.091915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '90ff76b8-6b3d-47fc-9e88-95c76e7bd11f'} Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:26.096066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. Aug 31 04:42:26.097540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:26.098900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Returning 404 to user: Instance 90ff76b8-6b3d-47fc-9e88-95c76e7bd11f could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:26.098900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-71479540-9b27-4ad3-8beb-fa1a087d62e1 tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f" status: 404 len: 111 microversion: 2.20 time: 0.047827 Aug 31 04:42:26.098900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 466/977] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:42:26 2022] GET /compute/v2.1/servers/90ff76b8-6b3d-47fc-9e88-95c76e7bd11f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:42:27.295942 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:27.296714 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:27.303836 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:27.304385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:27.304872 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:27.305618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:27.306148 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:27.306646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:27.321659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] HTTP exception thrown: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Request method failure captured: Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 HTTP/1.1 Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuTqBrCLSgEn8W1iHUKy-E7xU9miySITfwwiiNCzzfQxRRr5sZHorJFSn0t3bhHsTAOjlXvlBA356JbuI0wNXR3oLVeVKRbwC1UYEm9Xgo5WPrmIpItSRITLmeGJKEstwXBLKP82yuy9k_tY1LI_6_oHvc9K2i02F8EBP7L-T0Q8Z8U Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:42:27.323257 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bd54eb751f144b29b274e6a96dedcb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}] Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 13ac62bdb9bc4c7f94dad08f810559e9 Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.324928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '16ba9256-6be0-49de-8c61-4454227a18c8'} Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:27.325717 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.327607 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.329437 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Returning 404 to user: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:27.329437 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-58cff95b-32c2-4b6d-9e2c-b412f4c3a9eb tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "DELETE /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 404 len: 111 microversion: 2.20 time: 0.032973 Aug 31 04:42:27.329437 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 512/978] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 31 04:42:27 2022] DELETE /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:42:27.335254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:27.335872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] [instance: 16ba9256-6be0-49de-8c61-4454227a18c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:27.344059 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:27.344532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:27.344979 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:27.345657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:27.346096 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:27.346504 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:27.361881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] HTTP exception thrown: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Request method failure captured: Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 HTTP/1.1 Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuTqBrCLSgEn8W1iHUKy-E7xU9miySITfwwiiNCzzfQxRRr5sZHorJFSn0t3bhHsTAOjlXvlBA356JbuI0wNXR3oLVeVKRbwC1UYEm9Xgo5WPrmIpItSRITLmeGJKEstwXBLKP82yuy9k_tY1LI_6_oHvc9K2i02F8EBP7L-T0Q8Z8U Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:42:27.363457 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bd54eb751f144b29b274e6a96dedcb2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bd54eb751f144b29b274e6a96dedcb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bd54eb751f144b29b274e6a96dedcb2"}]}] Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 3bd54eb751f144b29b274e6a96dedcb2 Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1054648828 Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 13ac62bdb9bc4c7f94dad08f810559e9 Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1054648828-project Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.365092 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '16ba9256-6be0-49de-8c61-4454227a18c8'} Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:27.365879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. Aug 31 04:42:27.367193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:27.368536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] Returning 404 to user: Instance 16ba9256-6be0-49de-8c61-4454227a18c8 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:27.368536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-68675422-a258-496d-bc17-4cb10760f21e tempest-AttachVolumeShelveTestJSON-1054648828 tempest-AttachVolumeShelveTestJSON-1054648828-project] 10.222.0.42 "GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8" status: 404 len: 111 microversion: 2.20 time: 0.034405 Aug 31 04:42:27.368536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 467/979] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 31 04:42:27 2022] GET /compute/v2.1/servers/16ba9256-6be0-49de-8c61-4454227a18c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:42:41.931121 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1917823919", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1722327674", "security_groups": [{"name": "tempest-secgroup-smoke-1159417664"}], "networks": [{"uuid": "9c5bd141-9edf-4025-8041-65c7c72e8a5f"}], "block_device_mapping_v2": [{"uuid": "48b51904-da1d-448e-ad07-20ca85f3493b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:41.942689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:41.943841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=30 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:42.051540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] validate_networks() for [('9c5bd141-9edf-4025-8041-65c7c72e8a5f', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:42:42.153100 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:42.154185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:42.160471 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:42.161326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:42.161833 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:42.168296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.168991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.169486 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.170225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.170681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.171629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.200220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9189324c-0a8e-47fd-8895-2d45f2d2b29e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea/ips" status: 200 len: 151 microversion: 2.1 time: 0.052408 Aug 31 04:42:42.207371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 468/980] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:42:42 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:42.212556 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b4dac11-6526-4e03-99dc-80639e1061ff"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:42.215066 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:42.221542 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.222028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.222459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.224250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.224250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.224250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.317296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Invalid volume: volume 9b4dac11-6526-4e03-99dc-80639e1061ff is already attached to instances: 367213be-b6d0-4465-ab62-f280b288b2fb Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: POST /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea/os-volume_attachments HTTP/1.1 Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 74 Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:42:42.319202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {"volumeAttachment": {"volumeId": "9b4dac11-6526-4e03-99dc-80639e1061ff"}} Aug 31 04:42:42.320621 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Invalid volume: volume 9b4dac11-6526-4e03-99dc-80639e1061ff is already attached to instances: 367213be-b6d0-4465-ab62-f280b288b2fb Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'server_id': 'abb58876-fcb0-48d7-a852-830fb79567ea', 'body': {'volumeAttachment': {'volumeId': '9b4dac11-6526-4e03-99dc-80639e1061ff'}}} Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9b4dac11-6526-4e03-99dc-80639e1061ff is already attached to instances: 367213be-b6d0-4465-ab62-f280b288b2fb Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:42.321444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9b4dac11-6526-4e03-99dc-80639e1061ff is already attached to instances: 367213be-b6d0-4465-ab62-f280b288b2fb Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:42.322701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9b4dac11-6526-4e03-99dc-80639e1061ff is already attached to instances: 367213be-b6d0-4465-ab62-f280b288b2fb Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 400 to user: Invalid volume: volume 9b4dac11-6526-4e03-99dc-80639e1061ff is already attached to instances: 367213be-b6d0-4465-ab62-f280b288b2fb {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d9533b1c-1dd8-404d-acc5-c599d3c67fee tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112065 Aug 31 04:42:42.324874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 469/981] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:42:42 2022] POST /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:42:42.330501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:42.331123 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:42.337726 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.338293 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.339238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.339602 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.340114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.340636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.370885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:42:42.457545 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c999ce11-2094-4257-b4f6-ed398adde427 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 204 len: 0 microversion: 2.1 time: 0.131152 Aug 31 04:42:42.458452 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 470/982] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:42:42 2022] DELETE /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:42:42.467826 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:42.468870 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:42.474964 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.475591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.476099 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.476879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.477391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.477871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.493346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:42:42.493827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:42:42.494638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:42:42.495061 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:42:42.495466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:42:42.504597 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.505053 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.505647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.506356 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:42.506819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:42.507535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:42.524753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Getting quotas for project 69713aca5ac144f9bca8348430ab9c75. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:42:42.528670 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Getting quotas for user 81e0524ede63477a9875487d155be25e and project 69713aca5ac144f9bca8348430ab9c75. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:42:42.601068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:42:42.604179 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48b51904-da1d-448e-ad07-20ca85f3493b',volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:42:42.631799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:42.641948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-76724638-fe0a-4567-9a07-78ac11519664 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1683 microversion: 2.1 time: 0.178213 Aug 31 04:42:42.642711 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 471/983] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:42 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:42.756794 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f270176b-c250-4c53-862b-caefcd225347 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829641 Aug 31 04:42:42.757638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 513/984] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:42:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:42:42.768720 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3b5bf128-5699-4cfc-98e8-c567583f6173 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:42.769296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3b5bf128-5699-4cfc-98e8-c567583f6173 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:42.827633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3b5bf128-5699-4cfc-98e8-c567583f6173 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:42.837337 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3b5bf128-5699-4cfc-98e8-c567583f6173 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1089 microversion: 2.1 time: 0.072348 Aug 31 04:42:42.837907 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 472/985] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:42 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:42:43.665095 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:43.666107 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:43.673820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:43.674392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:43.675321 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:43.675668 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:43.676152 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:43.676572 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:43.847272 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:43.857615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b530bc72-3e93-47ac-ab01-adbbe6985a54 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1683 microversion: 2.1 time: 0.196930 Aug 31 04:42:43.858682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 514/986] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:43 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:43.859200 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:43.861289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:43.870751 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:43.871541 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:43.872479 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:43.873575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:43.874188 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:43.874776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:43.956297 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:43.965868 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6697d278-f84a-45ee-91f7-eed41a375889 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1131 microversion: 2.1 time: 0.110575 Aug 31 04:42:43.966548 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 473/987] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:43 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1131 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:42:44.887584 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:44.888295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:44.903484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:44.904045 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:44.904544 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:44.905710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:44.906280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:44.906792 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:44.971628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:44.979498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a48bf1e9-742a-4ccc-bc9d-7f1d69be094e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1615 microversion: 2.1 time: 0.097886 Aug 31 04:42:44.980214 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 515/988] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:44 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:42:44.987818 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:44.988644 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:44.995576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:44.996041 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:44.996544 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:44.997230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:44.997670 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:44.998231 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:45.116291 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:45.124427 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0da75078-4316-44ed-9dc0-c60fb39907b9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1205 microversion: 2.1 time: 0.141115 Aug 31 04:42:45.124959 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 474/989] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:44 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1205 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:45.289624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-7518e570-01d9-4fed-a77c-54d9572abd67 req-b0c1a6ce-275f-4e00-bd06-73f4f3266de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb58876-fcb0-48d7-a852-830fb79567ea", "name": "network-vif-deleted", "tag": "43245827-8072-4b30-b574-8f9a4e99070a"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:45.310667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7518e570-01d9-4fed-a77c-54d9572abd67 req-b0c1a6ce-275f-4e00-bd06-73f4f3266de9 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:45.312021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7518e570-01d9-4fed-a77c-54d9572abd67 req-b0c1a6ce-275f-4e00-bd06-73f4f3266de9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:45.312829 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-7518e570-01d9-4fed-a77c-54d9572abd67 req-b0c1a6ce-275f-4e00-bd06-73f4f3266de9 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:45.330445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-7518e570-01d9-4fed-a77c-54d9572abd67 req-b0c1a6ce-275f-4e00-bd06-73f4f3266de9 service nova] Creating event network-vif-deleted:43245827-8072-4b30-b574-8f9a4e99070a for instance abb58876-fcb0-48d7-a852-830fb79567ea on hv-cinder-85530 Aug 31 04:42:45.336333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-7518e570-01d9-4fed-a77c-54d9572abd67 req-b0c1a6ce-275f-4e00-bd06-73f4f3266de9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051650 Aug 31 04:42:45.336938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 516/990] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:46.002268 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:46.003080 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:46.011219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:46.011960 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:46.012402 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:46.013112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:46.014272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:46.014272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:46.071559 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:46.072050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:46.072530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:46.072992 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lazy-loading 'fault' on Instance uuid abb58876-fcb0-48d7-a852-830fb79567ea {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:42:46.141694 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:46.147188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:46.148118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:46.154088 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1a3c520b-ff72-4c10-b9e3-a7e45c0a5eb8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 200 len: 1331 microversion: 2.1 time: 0.152732 Aug 31 04:42:46.156470 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 475/991] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:45 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:46.162389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:46.163217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:46.165176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:46.166046 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:46.167703 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:46.169918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:46.400897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:46.410901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c22b3c82-60da-416a-911f-8e58e2e8e535 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1273 microversion: 2.1 time: 0.268713 Aug 31 04:42:46.411542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 517/992] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:46 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:42:47.180386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:47.180779 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:47.187305 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:47.187784 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:47.188794 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:47.189027 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:47.189357 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:47.189740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:47.204770 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea HTTP/1.1 Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:42:47.206704 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:42:47.208386 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': 'abb58876-fcb0-48d7-a852-830fb79567ea'} Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:47.213206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:42:47.214966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:47.216660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:47.216660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-95082f79-1ce5-4cb3-81fe-5e3bba588ddc tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 404 len: 111 microversion: 2.1 time: 0.032292 Aug 31 04:42:47.216660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 476/993] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:47 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:42:47.218366 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-bd2f90b3-5711-4128-8bb4-08e67d8fd193 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '.version_select at 0x7fc82a852160>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:47.239295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-bd2f90b3-5711-4128-8bb4-08e67d8fd193 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458399085" status: 202 len: 0 microversion: 2.1 time: 0.025428 Aug 31 04:42:47.240223 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 518/994] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 31 04:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458399085 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:42:47.354435 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6523bf54-7a25-4f90-9289-00337f8aa432 req-16cfe602-ad18-4543-8937-c9f27767a737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3339d1f4-1f06-4585-aba3-ed352579d75a", "tag": "ae65d506-d89f-4468-a25b-cf6f8e85f73e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:47.367014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6523bf54-7a25-4f90-9289-00337f8aa432 req-16cfe602-ad18-4543-8937-c9f27767a737 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:47.367563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6523bf54-7a25-4f90-9289-00337f8aa432 req-16cfe602-ad18-4543-8937-c9f27767a737 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:47.368055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6523bf54-7a25-4f90-9289-00337f8aa432 req-16cfe602-ad18-4543-8937-c9f27767a737 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:47.379911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6523bf54-7a25-4f90-9289-00337f8aa432 req-16cfe602-ad18-4543-8937-c9f27767a737 service nova] Creating event network-changed:ae65d506-d89f-4468-a25b-cf6f8e85f73e for instance 3339d1f4-1f06-4585-aba3-ed352579d75a on hv-cinder-85530 Aug 31 04:42:47.385269 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6523bf54-7a25-4f90-9289-00337f8aa432 req-16cfe602-ad18-4543-8937-c9f27767a737 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034828 Aug 31 04:42:47.386153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 477/995] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:47.432692 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:47.433304 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:47.444664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:47.444664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:47.444664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:47.445017 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:47.445336 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:47.446012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:47.605645 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:47.618405 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-47315b82-090d-4693-b996-0e9bef98c877 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.189204 Aug 31 04:42:47.619335 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 519/996] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:47 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:48.199994 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:48.200639 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:48.208072 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:48.208611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:48.209348 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:48.209935 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:48.210468 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:48.211013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:48.305285 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lazy-loading 'services' on Instance uuid 367213be-b6d0-4465-ab62-f280b288b2fb {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:42:48.388860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c145e013-09d1-42e3-9806-174b31f40603 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments/9b4dac11-6526-4e03-99dc-80639e1061ff" status: 202 len: 0 microversion: 2.1 time: 0.193133 Aug 31 04:42:48.389530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 478/997] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:42:48 2022] DELETE /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments/9b4dac11-6526-4e03-99dc-80639e1061ff => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:42:48.399105 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:48.401696 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:48.410507 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:48.411057 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:48.411591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:48.412310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:48.412977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:48.413398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:48.474543 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9bbf525f-0d51-4498-8df7-30c39b12b5f1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079972 Aug 31 04:42:48.475308 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 520/998] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:42:48 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:48.644343 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:48.645236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:48.653678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:48.654211 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:48.654746 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:48.655775 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:48.656335 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:48.656855 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:48.794308 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:48.802442 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1f1e5e95-9c41-494c-a2aa-8d7c4c138e8d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.164132 Aug 31 04:42:48.803050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 479/999] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:48 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:49.491761 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:49.495443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:49.504977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.505539 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.506011 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.506842 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.507365 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.507832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.537331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-afd4dc93-69d1-4cec-bb87-a1ddc9ceb2b3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052812 Aug 31 04:42:49.537887 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 521/1000] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:42:49 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:42:49.600447 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:49.600970 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:49.607992 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.608471 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.608901 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.609836 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.610656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.611115 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.638515 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:42:49.721580 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-997ac3d7-9223-463c-8214-940534543558 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 204 len: 0 microversion: 2.1 time: 0.124793 Aug 31 04:42:49.722451 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 480/1001] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:42:49 2022] DELETE /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:42:49.731003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:49.731609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:49.738201 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.738665 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.739117 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.739787 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.740228 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.740643 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.825161 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:49.825948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:49.832738 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.833224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.833682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.834380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:49.834939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:49.835359 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:49.887513 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:49.895937 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-58918a85-46d5-4d39-982f-6e895d298906 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1683 microversion: 2.1 time: 0.168818 Aug 31 04:42:49.896497 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 522/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:49 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:49.969975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:49.980224 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-87974919-ccd1-435e-996f-a019083278ad tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.159199 Aug 31 04:42:49.981045 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 481/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:49 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:50.921106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:50.921946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:50.932907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:50.933688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:50.934397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:50.935567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:50.936295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:50.936936 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:51.003112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:51.005253 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:51.012473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:51.012947 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:51.013372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:51.014057 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:51.014615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:51.015055 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:51.080143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:51.088260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b42e343b-bc75-486f-84a2-1ecdf7a7a21b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1683 microversion: 2.1 time: 0.173774 Aug 31 04:42:51.088802 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 523/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:50 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:51.152444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:51.156064 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:51.162416 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-995f3b0c-d309-4fb5-a41f-b9f648469cee tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.163234 Aug 31 04:42:51.163207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 482/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:50 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:52.108660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:52.109286 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:52.116885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:52.117352 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:52.117776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:52.118468 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:52.118959 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:52.119397 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:52.184680 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:52.185399 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:52.185834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:52.194355 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4fcf1307-76b1-422d-9b02-91245fbdf46b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1615 microversion: 2.1 time: 0.089548 Aug 31 04:42:52.194633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:52.195162 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 524/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:52 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:52.195288 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:52.195778 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:52.196629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:52.197191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:52.197741 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:52.536825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:52.545656 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0740e90e-a159-4752-b2e9-5088416dd570 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.365876 Aug 31 04:42:52.546308 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 483/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:52 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:42:52.575686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-1bf9c49b-2568-40f3-992f-008e9fc3172e req-40737015-c7e0-47f5-82f1-4e3d9ef2198f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367213be-b6d0-4465-ab62-f280b288b2fb", "name": "network-vif-deleted", "tag": "7e1f8894-0351-476c-8955-19dca2560661"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:52.581725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:52.582870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=6 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:52.588670 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-1bf9c49b-2568-40f3-992f-008e9fc3172e req-40737015-c7e0-47f5-82f1-4e3d9ef2198f service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:52.589507 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-1bf9c49b-2568-40f3-992f-008e9fc3172e req-40737015-c7e0-47f5-82f1-4e3d9ef2198f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:52.589989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-1bf9c49b-2568-40f3-992f-008e9fc3172e req-40737015-c7e0-47f5-82f1-4e3d9ef2198f service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:52.602487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-1bf9c49b-2568-40f3-992f-008e9fc3172e req-40737015-c7e0-47f5-82f1-4e3d9ef2198f service nova] Creating event network-vif-deleted:7e1f8894-0351-476c-8955-19dca2560661 for instance 367213be-b6d0-4465-ab62-f280b288b2fb on hv-cinder-85530 Aug 31 04:42:52.607662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-1bf9c49b-2568-40f3-992f-008e9fc3172e req-40737015-c7e0-47f5-82f1-4e3d9ef2198f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036905 Aug 31 04:42:52.608822 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 525/1008] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:53.217089 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:53.217914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:53.219958 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:53.227212 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:53.227980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:53.228687 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:53.229697 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:53.230368 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:53.231065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:53.267676 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:53.268563 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:53.268891 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:53.269340 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lazy-loading 'fault' on Instance uuid 367213be-b6d0-4465-ab62-f280b288b2fb {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:42:53.314097 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:53.322431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8bc50856-6a37-4ed9-82ad-445c537913e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 200 len: 1332 microversion: 2.1 time: 0.109239 Aug 31 04:42:53.323042 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 484/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:53 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:53.570024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:53.571128 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:53.578192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:53.578891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:53.579399 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:53.580342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:53.580858 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:53.581361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:53.744151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:53.753419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-498391f2-6f14-4387-a88b-1192b28204fb tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.188886 Aug 31 04:42:53.753993 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 526/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:53 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:54.344485 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:54.345047 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:54.352505 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:54.352990 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:54.353435 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:54.354124 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:54.354572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:54.355025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:54.369953 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb HTTP/1.1 Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:42:54.371647 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:42:54.373361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '367213be-b6d0-4465-ab62-f280b288b2fb'} Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:42:54.374574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:42:54.376692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:42:54.379130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:42:54.379130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-080609c7-9518-4d96-ac4b-a0809a49a847 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 404 len: 111 microversion: 2.1 time: 0.032847 Aug 31 04:42:54.379130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 485/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:54 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:42:54.383588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c523e378-de1f-4c57-b977-c2f05f2608a2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '.version_select at 0x7fc826fbe790>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:54.405739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c523e378-de1f-4c57-b977-c2f05f2608a2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231962491" status: 202 len: 0 microversion: 2.1 time: 0.026164 Aug 31 04:42:54.406297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 527/1012] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 31 04:42:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231962491 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:42:54.777897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:54.778822 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:54.793878 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:54.794376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:54.795694 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:54.796411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:54.796868 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:54.797288 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:55.265178 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:55.274254 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-54f22bb2-2f6b-4ba2-b9de-8ac701d12d21 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.502802 Aug 31 04:42:55.274860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 486/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:54 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:55.437768 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8eca2056-b7d0-45be-aa8f-445af55c4397 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: .version_select at 0x7fc8270629d0>, body: {"keypair": {"name": "tempest-keypair-51032293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb9sS/wiGx7UslvWJYL6UGvhAiP84TVqo01ZK/8+GNSvX4RO1lrqbHeuuNcDdbaDYgcD41rUMoLR3EV3sVlRSag9GshFgJOhZUiF1yREEnmJuvZMRAOdWBcRAR06XgpCQ=="}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:55.455298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-8eca2056-b7d0-45be-aa8f-445af55c4397 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:42:55.459382 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-8eca2056-b7d0-45be-aa8f-445af55c4397 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:42:55.483176 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8eca2056-b7d0-45be-aa8f-445af55c4397 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049886 Aug 31 04:42:55.483776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 528/1014] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:42:55 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:42:56.295607 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:56.296322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:56.302848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:56.303409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:56.303914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:56.304667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:56.305181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:56.305662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:56.546461 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:56.559420 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e67caca2-667c-4eaf-80d7-b72002206eff tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.267704 Aug 31 04:42:56.560301 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 487/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:56 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:56.674068 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-9b8eb814-ecf1-499c-b806-2cef78c930cc req-d4a17d72-cc97-4c48-867a-2341b5968dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3339d1f4-1f06-4585-aba3-ed352579d75a", "name": "network-vif-plugged", "status": "completed", "tag": "ae65d506-d89f-4468-a25b-cf6f8e85f73e"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:56.684701 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-9b8eb814-ecf1-499c-b806-2cef78c930cc req-d4a17d72-cc97-4c48-867a-2341b5968dcd service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:56.685679 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-9b8eb814-ecf1-499c-b806-2cef78c930cc req-d4a17d72-cc97-4c48-867a-2341b5968dcd service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:56.686221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-9b8eb814-ecf1-499c-b806-2cef78c930cc req-d4a17d72-cc97-4c48-867a-2341b5968dcd service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:56.700125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-9b8eb814-ecf1-499c-b806-2cef78c930cc req-d4a17d72-cc97-4c48-867a-2341b5968dcd service nova] Creating event network-vif-plugged:ae65d506-d89f-4468-a25b-cf6f8e85f73e for instance 3339d1f4-1f06-4585-aba3-ed352579d75a on hv-cinder-85530 Aug 31 04:42:56.705471 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-9b8eb814-ecf1-499c-b806-2cef78c930cc req-d4a17d72-cc97-4c48-867a-2341b5968dcd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036461 Aug 31 04:42:56.706066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 529/1016] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:42:56.964220 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-365924553", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5e1d21-0d94-4325-a39c-d7a84e70a79f"}], "security_groups": [{"name": "tempest-securitygroup--1663323208"}], "key_name": "tempest-keypair-51032293", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:42:57.077240 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] validate_networks() for [('9f5e1d21-0d94-4325-a39c-d7a84e70a79f', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:42:57.481431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:42:57.482045 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:42:57.482311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:42:57.482739 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:42:57.483185 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:42:57.494976 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:57.495514 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:57.495984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:57.496854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:57.497397 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:57.497905 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:57.523321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:42:57.529213 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:42:57.543945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:42:57.548102 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:42:57.581837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:57.582540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:57.589452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:57.589926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:57.590354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:57.591106 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:57.591592 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:57.592030 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:57.606379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3526fc67-9697-460a-97ad-460558f389a9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.645778 Aug 31 04:42:57.607792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 488/1017] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:42:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:42:57.619450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7260631a-aecc-4632-8aeb-ffaba5811a29 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:57.620186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7260631a-aecc-4632-8aeb-ffaba5811a29 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:57.679107 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7260631a-aecc-4632-8aeb-ffaba5811a29 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:57.686156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7260631a-aecc-4632-8aeb-ffaba5811a29 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1239 microversion: 2.1 time: 0.070922 Aug 31 04:42:57.686810 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 489/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:57 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:57.748682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:57.757289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c62cb24e-7b32-44e4-b739-fd555d6bc304 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1261 microversion: 2.1 time: 0.180002 Aug 31 04:42:57.759942 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 530/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:57 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:42:58.708406 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:58.709079 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:58.716541 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:58.716959 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:58.717375 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:58.718071 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:58.718540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:58.719209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:58.777586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:58.778307 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:58.785508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:58.785992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:58.786411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:58.787127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:58.787567 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:58.787977 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:58.793329 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:58.801449 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9dd939f3-9087-48f6-bcba-a88aef674686 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1291 microversion: 2.1 time: 0.098039 Aug 31 04:42:58.802014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 490/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:58 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1291 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:58.922024 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:58.930343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-47308218-2562-4ab3-8a8a-954fea6b6774 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1444 microversion: 2.1 time: 0.156623 Aug 31 04:42:58.930948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 531/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:58 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:58.950506 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:58.951181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:58.957805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:58.958223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:58.958649 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:58.959394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:58.959836 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:58.960251 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:59.143272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:42:59.151084 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b60984f-b1b0-4981-8004-ee979489f59f tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1444 microversion: 2.1 time: 0.204495 Aug 31 04:42:59.152028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 491/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:58 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1444 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:42:59.825455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:42:59.826407 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:42:59.836328 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:59.837050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:59.837673 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:42:59.838466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:42:59.839007 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:42:59.839488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:00.122434 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:00.131133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a5d63a4f-21b2-4eaa-90eb-8cc572cfcc5a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1365 microversion: 2.1 time: 0.312082 Aug 31 04:43:00.145635 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 532/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:42:59 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:00.580803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-75e3d786-0a44-4b04-a188-86b1d3389a7b req-d27d6bac-6f7d-4c9c-9655-631b4725e700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc8b1ad-a81b-474b-90c3-d51d4e2c693b", "tag": "93bd7884-9dc0-4a3f-ac00-735fd8754eb9"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:00.594133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-75e3d786-0a44-4b04-a188-86b1d3389a7b req-d27d6bac-6f7d-4c9c-9655-631b4725e700 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:00.594975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-75e3d786-0a44-4b04-a188-86b1d3389a7b req-d27d6bac-6f7d-4c9c-9655-631b4725e700 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:00.595401 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-75e3d786-0a44-4b04-a188-86b1d3389a7b req-d27d6bac-6f7d-4c9c-9655-631b4725e700 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:00.608906 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-75e3d786-0a44-4b04-a188-86b1d3389a7b req-d27d6bac-6f7d-4c9c-9655-631b4725e700 service nova] Creating event network-changed:93bd7884-9dc0-4a3f-ac00-735fd8754eb9 for instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b on hv-cinder-85530 Aug 31 04:43:00.614444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-75e3d786-0a44-4b04-a188-86b1d3389a7b req-d27d6bac-6f7d-4c9c-9655-631b4725e700 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037975 Aug 31 04:43:00.615089 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 492/1024] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:43:01.152733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:01.153429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:01.160369 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:01.160851 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:01.161276 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:01.161971 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:01.162416 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:01.162864 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:01.345254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:01.355448 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b2262711-bf12-4886-b367-cc7ead52889b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1365 microversion: 2.1 time: 0.206621 Aug 31 04:43:01.370160 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 533/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:01 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:01.398209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-29574571-e4eb-4b09-832a-057bca3fc942 req-bb862b3a-7f8d-4c50-8ce1-c501403f13e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3339d1f4-1f06-4585-aba3-ed352579d75a", "tag": "ae65d506-d89f-4468-a25b-cf6f8e85f73e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:01.408616 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-29574571-e4eb-4b09-832a-057bca3fc942 req-bb862b3a-7f8d-4c50-8ce1-c501403f13e3 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:01.409325 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-29574571-e4eb-4b09-832a-057bca3fc942 req-bb862b3a-7f8d-4c50-8ce1-c501403f13e3 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:01.409950 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-29574571-e4eb-4b09-832a-057bca3fc942 req-bb862b3a-7f8d-4c50-8ce1-c501403f13e3 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:01.423079 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-29574571-e4eb-4b09-832a-057bca3fc942 req-bb862b3a-7f8d-4c50-8ce1-c501403f13e3 service nova] Creating event network-changed:ae65d506-d89f-4468-a25b-cf6f8e85f73e for instance 3339d1f4-1f06-4585-aba3-ed352579d75a on hv-cinder-85530 Aug 31 04:43:01.429636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-29574571-e4eb-4b09-832a-057bca3fc942 req-bb862b3a-7f8d-4c50-8ce1-c501403f13e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035438 Aug 31 04:43:01.433845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 493/1026] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:43:02.377505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:02.378542 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:02.385373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:02.385937 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:02.386394 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:02.387376 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:02.388031 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:02.388846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:02.537890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:02.546602 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b6811639-3222-4b0d-af15-e5ce1779e346 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1365 microversion: 2.1 time: 0.173093 Aug 31 04:43:02.558870 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 534/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:02 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:03.572498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:03.573684 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:03.581253 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:03.581728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:03.582153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:03.582871 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:03.583319 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:03.583733 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:03.717766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:03.725885 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-397eda15-6ba8-4d70-a42c-a16e4a96cbe5 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1365 microversion: 2.1 time: 0.161272 Aug 31 04:43:03.726454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 494/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:03 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:04.688028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-0ba61ac4-045e-4cea-be5f-aa668f9c80aa req-aaa8fc30-8be9-4b9f-ac24-3e2b8b413e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc8b1ad-a81b-474b-90c3-d51d4e2c693b", "name": "network-vif-plugged", "status": "completed", "tag": "93bd7884-9dc0-4a3f-ac00-735fd8754eb9"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:04.698391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0ba61ac4-045e-4cea-be5f-aa668f9c80aa req-aaa8fc30-8be9-4b9f-ac24-3e2b8b413e38 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:04.698955 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0ba61ac4-045e-4cea-be5f-aa668f9c80aa req-aaa8fc30-8be9-4b9f-ac24-3e2b8b413e38 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:04.699346 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-0ba61ac4-045e-4cea-be5f-aa668f9c80aa req-aaa8fc30-8be9-4b9f-ac24-3e2b8b413e38 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:04.703473 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=100 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:04.711843 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-0ba61ac4-045e-4cea-be5f-aa668f9c80aa req-aaa8fc30-8be9-4b9f-ac24-3e2b8b413e38 service nova] Creating event network-vif-plugged:93bd7884-9dc0-4a3f-ac00-735fd8754eb9 for instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b on hv-cinder-85530 Aug 31 04:43:04.716709 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-0ba61ac4-045e-4cea-be5f-aa668f9c80aa req-aaa8fc30-8be9-4b9f-ac24-3e2b8b413e38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Aug 31 04:43:04.717303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 535/1029] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:43:04.748533 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:04.749156 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:04.756666 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:04.757152 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:04.757587 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:04.758337 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:04.758705 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:04.759217 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:04.892806 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:04.900725 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ec3e963c-75c5-48f9-88c0-7ebc3639f3b1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1365 microversion: 2.1 time: 0.156365 Aug 31 04:43:04.901312 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 495/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:04 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:05.926808 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:05.927946 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:05.931130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=4 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:05.941113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:05.941753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:05.942408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:05.943455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:05.943972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:05.944421 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:06.078856 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:06.086913 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f9f54bf7-0e42-470f-956a-c07492f62bae tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1365 microversion: 2.1 time: 0.167353 Aug 31 04:43:06.087485 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 536/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:05 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:07.118289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:07.119232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:07.129290 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:07.130010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:07.130652 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:07.131745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:07.132414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:07.133052 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:07.269838 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:07.278237 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-165d6cbf-663d-452b-af77-4859b908803c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1556 microversion: 2.1 time: 0.165969 Aug 31 04:43:07.279103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 496/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:07 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:07.299181 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:07.299775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:07.306206 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:07.306687 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:07.307151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:07.307823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:07.308266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:07.308680 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:07.400408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d6dd71ad-7d3e-4567-b69c-8f10f3706d82 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105565 Aug 31 04:43:07.401037 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 537/1033] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:43:07 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:43:08.359932 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-9ac15d78-c442-41de-885c-39950c30e6bb req-7821ad15-1354-476e-9fac-b58a8d7bcc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc8b1ad-a81b-474b-90c3-d51d4e2c693b", "tag": "93bd7884-9dc0-4a3f-ac00-735fd8754eb9"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:08.364800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:08.365462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:08.372425 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9ac15d78-c442-41de-885c-39950c30e6bb req-7821ad15-1354-476e-9fac-b58a8d7bcc77 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:08.372895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9ac15d78-c442-41de-885c-39950c30e6bb req-7821ad15-1354-476e-9fac-b58a8d7bcc77 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:08.373307 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9ac15d78-c442-41de-885c-39950c30e6bb req-7821ad15-1354-476e-9fac-b58a8d7bcc77 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:08.384393 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-9ac15d78-c442-41de-885c-39950c30e6bb req-7821ad15-1354-476e-9fac-b58a8d7bcc77 service nova] Creating event network-changed:93bd7884-9dc0-4a3f-ac00-735fd8754eb9 for instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b on hv-cinder-85530 Aug 31 04:43:08.389286 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-9ac15d78-c442-41de-885c-39950c30e6bb req-7821ad15-1354-476e-9fac-b58a8d7bcc77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033093 Aug 31 04:43:08.389851 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 497/1034] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:43:44.270957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:44.271706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=10 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:44.276864 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:44.277354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:44.284917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:44.285461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:44.285880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:44.286589 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:44.287050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:44.287456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:44.320718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7abde588-2125-41c5-90fd-5f9d641b4a99 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/ips" status: 200 len: 151 microversion: 2.1 time: 0.051386 Aug 31 04:43:44.321285 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 538/1035] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:43:44 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:43:45.670263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:45.671243 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=66 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:45.676998 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5617c6a0-d6f2-4a4a-9a3e-918bf04978a3"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:45.680426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:45.688481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:45.688980 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:45.689414 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:45.690115 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:45.690611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:45.691056 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:45.977215 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9e386c89-6852-471a-94d3-cb69d5418af2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309176 Aug 31 04:43:45.977875 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 498/1036] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:43:45 2022] POST /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:43:53.562838 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5617c6a0-d6f2-4a4a-9a3e-918bf04978a3"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:53.565310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:53.572206 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.572683 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.573105 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.573791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.574225 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.574661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.657064 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Invalid volume: volume 5617c6a0-d6f2-4a4a-9a3e-918bf04978a3 is already attached to instances: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: POST /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments HTTP/1.1 Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 74 Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:43:53.658846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {"volumeAttachment": {"volumeId": "5617c6a0-d6f2-4a4a-9a3e-918bf04978a3"}} Aug 31 04:43:53.660582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Invalid volume: volume 5617c6a0-d6f2-4a4a-9a3e-918bf04978a3 is already attached to instances: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'server_id': '7bc8b1ad-a81b-474b-90c3-d51d4e2c693b', 'body': {'volumeAttachment': {'volumeId': '5617c6a0-d6f2-4a4a-9a3e-918bf04978a3'}}} Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5617c6a0-d6f2-4a4a-9a3e-918bf04978a3 is already attached to instances: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:53.661495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5617c6a0-d6f2-4a4a-9a3e-918bf04978a3 is already attached to instances: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:43:53.663028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5617c6a0-d6f2-4a4a-9a3e-918bf04978a3 is already attached to instances: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 400 to user: Invalid volume: volume 5617c6a0-d6f2-4a4a-9a3e-918bf04978a3 is already attached to instances: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c4469d80-1cc1-4119-bd49-3c612dce6f3a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102202 Aug 31 04:43:53.664688 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 539/1037] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:43:53 2022] POST /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:43:53.728433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:53.729060 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:53.735990 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.736471 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.736895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.737579 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.738018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.738430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.822194 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lazy-loading 'services' on Instance uuid 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:43:53.860491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:53.861026 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:53.868306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.868791 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.869219 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.869915 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.870342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.870893 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.897846 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:43:53.902921 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c08ee59a-7963-41f4-a4c2-b602b98186e0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments/5617c6a0-d6f2-4a4a-9a3e-918bf04978a3" status: 202 len: 0 microversion: 2.1 time: 0.178575 Aug 31 04:43:53.903602 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 499/1038] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:43:53 2022] DELETE /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments/5617c6a0-d6f2-4a4a-9a3e-918bf04978a3 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:43:53.914206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:53.916872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:53.924087 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.924551 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.924971 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.925662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.926133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.926575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.957752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-651b32fe-c7b9-4e94-9be1-91973871bb13 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049466 Aug 31 04:43:53.958317 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 500/1039] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:43:53 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:43:53.980435 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-95b23129-595c-42c1-83d6-6502eeaff030 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 204 len: 0 microversion: 2.1 time: 0.123584 Aug 31 04:43:53.981019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 540/1040] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:43:53 2022] DELETE /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:43:53.989372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:53.989978 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:53.996413 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.996881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.997300 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:53.997981 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:53.998418 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:53.998860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:54.135429 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:54.143857 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f6ca7e5-3f33-4ef2-9f54-e392d87dc4b9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1579 microversion: 2.1 time: 0.158477 Aug 31 04:43:54.144419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 501/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:53 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:54.975342 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:54.978270 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:54.984942 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:54.985429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:54.985848 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:54.986531 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:54.987000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:54.987405 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:55.018035 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2642cb59-7a91-4950-8485-db415cd2d909 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050168 Aug 31 04:43:55.018593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 541/1042] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:43:54 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:43:55.176018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:55.177015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:55.185154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:55.185633 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:55.186056 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:55.186746 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:55.187208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:55.187625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:55.323135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:55.331238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c53b056e-214d-49f7-a733-da70370bc55e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1579 microversion: 2.1 time: 0.161810 Aug 31 04:43:55.331806 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 502/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:55 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:56.030757 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:56.033123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:56.039891 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:56.040370 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:56.040978 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:56.041667 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:56.042111 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:56.042505 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:56.076426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ddc8879c-aa31-4491-b431-20f02178bdf8 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048979 Aug 31 04:43:56.076426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 542/1044] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:43:56 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:43:56.354013 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:56.354738 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:56.361509 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:56.361991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:56.362423 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:56.363250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:56.363709 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:56.364273 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:56.586433 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:56.595322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d27e47ae-f8c7-4204-8483-128f38a21f43 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1579 microversion: 2.1 time: 0.245450 Aug 31 04:43:56.596122 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 503/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:56 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1579 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:43:57.088968 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:57.091483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:57.098044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.098519 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.098982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.099670 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.100118 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.100525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.127759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c95caa87-2263-4fe8-88e9-35921beefc5d req-5cd43cd4-5c5d-4cdb-9645-a382ca8d099c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1083f879-d1a1-4430-8b82-35a8833d029d", "name": "network-vif-deleted", "tag": "6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:57.133580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f31aad9b-fd4c-42e3-a529-4ff8effc1c49 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049057 Aug 31 04:43:57.134991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 543/1046] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:43:57 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:43:57.141133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c95caa87-2263-4fe8-88e9-35921beefc5d req-5cd43cd4-5c5d-4cdb-9645-a382ca8d099c service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.141133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c95caa87-2263-4fe8-88e9-35921beefc5d req-5cd43cd4-5c5d-4cdb-9645-a382ca8d099c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.141133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c95caa87-2263-4fe8-88e9-35921beefc5d req-5cd43cd4-5c5d-4cdb-9645-a382ca8d099c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.150974 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c95caa87-2263-4fe8-88e9-35921beefc5d req-5cd43cd4-5c5d-4cdb-9645-a382ca8d099c service nova] Creating event network-vif-deleted:6bb6f7f8-24e3-412e-8f08-6e1663a2f6ae for instance 1083f879-d1a1-4430-8b82-35a8833d029d on hv-cinder-85530 Aug 31 04:43:57.155954 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c95caa87-2263-4fe8-88e9-35921beefc5d req-5cd43cd4-5c5d-4cdb-9645-a382ca8d099c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Aug 31 04:43:57.159591 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 504/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:43:57.203189 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:57.203685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:57.209876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.210359 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.211008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.211874 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.213306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.213901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.241213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:43:57.342523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5ecd56f0-eec0-4c72-86c5-f797b11b1b1c tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 204 len: 0 microversion: 2.1 time: 0.142776 Aug 31 04:43:57.347134 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 544/1048] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:43:57 2022] DELETE /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:43:57.353444 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:57.355126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:57.370456 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.370966 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.371390 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.372095 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.372535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.372945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.515171 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:57.527965 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-040c4175-7a93-4e06-a2ba-692a7ef6a3d2 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1681 microversion: 2.1 time: 0.178828 Aug 31 04:43:57.528527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 505/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:57 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:57.617629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:57.618232 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:57.625514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.626004 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.626435 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.627175 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:57.627624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:57.628140 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:57.698354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:57.707029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-fd58eac2-3769-4f59-95cb-280ab333a1f5 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1226 microversion: 2.1 time: 0.093721 Aug 31 04:43:57.707725 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 545/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:57 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:58.549789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:58.550334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:58.557315 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:58.557790 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:58.558213 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:58.558939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:58.559363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:58.559776 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:58.696630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:58.705630 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b357daad-0736-4c7a-b187-ea2df47850d6 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1681 microversion: 2.1 time: 0.159972 Aug 31 04:43:58.706233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 506/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:58 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:58.728008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:58.728847 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:58.735948 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:58.736424 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:58.736843 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:58.737534 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:58.737970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:58.738385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:58.773739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:58.774530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:58.774967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:58.776409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lazy-loading 'fault' on Instance uuid 1083f879-d1a1-4430-8b82-35a8833d029d {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:43:58.818332 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:58.826163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-97da8347-891f-412a-9d94-f09bc03c48c8 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 200 len: 1231 microversion: 2.1 time: 0.102579 Aug 31 04:43:58.826706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 546/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:58 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:43:59.727823 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:59.728483 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:59.735119 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:59.735593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:59.736020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:59.736708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:59.737154 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:59.737572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:59.847625 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:43:59.848303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:43:59.855795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:59.856537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:59.856961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:59.857646 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:43:59.858086 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:43:59.858508 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:43:59.872443 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] HTTP exception thrown: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Request method failure captured: Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d HTTP/1.1 Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZaBFypaa50UzmiZrqmAQxa2X9-cBZjitMtwFruzv98yWp4Q7d3BXh9SMeRxY6CexQ_tyUHDq_K5nu0kTEkDlYhoG-YaoATa47VrF_O_UnIj23bhfE4_vRBmmLavP8GeUWx5cIBtZfUb8cBBYdKzzS4ZFdyMqZZcbs-hAYH-z4uRbM Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:43:59.874123 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_312b9335479c4d72b78a20bb2f1b7296", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}] Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-TestVolumeBootPattern-786249260 Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: c11d44667e8e4db5bccccaee16d89a51 Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:43:59.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '1083f879-d1a1-4430-8b82-35a8833d029d'} Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:43:59.876834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:43:59.878339 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:43:59.879783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Returning 404 to user: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:43:59.879783 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-517980d3-c8b6-456e-b0dd-007f918cf416 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 404 len: 111 microversion: 2.1 time: 0.032204 Aug 31 04:43:59.884385 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 547/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:59 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:43:59.970767 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:43:59.978902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-955569360", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1950589606", "security_groups": [{"name": "tempest-secgroup-smoke-2075500102"}], "block_device_mapping_v2": [{"uuid": "46960b11-0be0-411c-8e90-0fb2b8aceec5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c418a9e6-611c-4446-9f40-8356037355dc"}]}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:43:59.979167 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-afd6568e-0955-49aa-8474-0512587dcf4d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 200 len: 1681 microversion: 2.1 time: 0.255229 Aug 31 04:43:59.992757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 507/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:43:59 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:00.095721 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] validate_networks() for [('c418a9e6-611c-4446-9f40-8356037355dc', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:44:00.191137 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-823254fb-30fe-4bec-8682-0b26e5186f82 req-9b7a9b7a-99a0-4ed8-9c62-4f95657b4d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc8b1ad-a81b-474b-90c3-d51d4e2c693b", "name": "network-vif-deleted", "tag": "93bd7884-9dc0-4a3f-ac00-735fd8754eb9"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:00.221201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-823254fb-30fe-4bec-8682-0b26e5186f82 req-9b7a9b7a-99a0-4ed8-9c62-4f95657b4d5c service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:00.221734 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-823254fb-30fe-4bec-8682-0b26e5186f82 req-9b7a9b7a-99a0-4ed8-9c62-4f95657b4d5c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:00.222318 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-823254fb-30fe-4bec-8682-0b26e5186f82 req-9b7a9b7a-99a0-4ed8-9c62-4f95657b4d5c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:00.242282 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-823254fb-30fe-4bec-8682-0b26e5186f82 req-9b7a9b7a-99a0-4ed8-9c62-4f95657b4d5c service nova] Creating event network-vif-deleted:93bd7884-9dc0-4a3f-ac00-735fd8754eb9 for instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b on hv-cinder-85530 Aug 31 04:44:00.249561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-823254fb-30fe-4bec-8682-0b26e5186f82 req-9b7a9b7a-99a0-4ed8-9c62-4f95657b4d5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061927 Aug 31 04:44:00.250445 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 508/1055] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:00.527006 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:44:00.527527 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:44:00.528096 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:44:00.528565 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:44:00.529021 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:44:00.537884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:00.538441 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:00.538967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:00.539820 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:00.540322 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:00.540821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:00.559086 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:44:00.563764 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for user c11d44667e8e4db5bccccaee16d89a51 and project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:44:00.622640 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:44:00.624967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46960b11-0be0-411c-8e90-0fb2b8aceec5',volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:44:00.774525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-5b62bdaf-0f8d-45d2-97ce-e5720967028d tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.801106 Aug 31 04:44:00.781037 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 548/1056] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:43:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 04:44:00.786577 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cfcd3da2-4a8f-44ff-993a-15ff05c4eb7a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:00.787278 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cfcd3da2-4a8f-44ff-993a-15ff05c4eb7a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:00.855628 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cfcd3da2-4a8f-44ff-993a-15ff05c4eb7a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:00.864020 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cfcd3da2-4a8f-44ff-993a-15ff05c4eb7a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1094 microversion: 2.1 time: 0.081485 Aug 31 04:44:00.878345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 509/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:00 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:01.000029 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:01.000758 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:01.007806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:01.008643 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:01.009273 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:01.010207 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:01.010676 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:01.011120 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:01.026411 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b HTTP/1.1 Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:44:01.028824 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:44:01.030491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '7bc8b1ad-a81b-474b-90c3-d51d4e2c693b'} Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:44:01.032108 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:44:01.033630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:44:01.035076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:44:01.035076 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-07dc1525-12d8-4f60-9fd1-938da5657e65 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 404 len: 111 microversion: 2.1 time: 0.034107 Aug 31 04:44:01.039959 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cb8a97cc-720a-455d-bc70-91c2c48b400e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '.version_select at 0x7fc82746ac10>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:01.044781 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 549/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:00 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:44:01.061005 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cb8a97cc-720a-455d-bc70-91c2c48b400e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51032293" status: 202 len: 0 microversion: 2.1 time: 0.024853 Aug 31 04:44:01.065717 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 510/1059] 10.222.0.42 () {58 vars in 1215 bytes} [Wed Aug 31 04:44:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51032293 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:44:01.752155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4929d469-eff1-4c06-ae59-ca19eed65190 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: .version_select at 0x7fc82a88d310>, body: {"keypair": {"name": "tempest-keypair-595217070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3UhCBa0v8vqYHaTh6AlBjykNvwVP4UamIgDefwm19fWfV9wSj+FkkGjtyhnk8khm4brsmI0Pdc54V1FDJJ/Wmg+MZRq7FyUKb3XYaz9d7kprkiSc1MIhqeo3jPlCUrWA=="}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:01.767125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-4929d469-eff1-4c06-ae59-ca19eed65190 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:44:01.770883 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-4929d469-eff1-4c06-ae59-ca19eed65190 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'key_pairs'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:44:01.792655 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4929d469-eff1-4c06-ae59-ca19eed65190 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044303 Aug 31 04:44:01.799336 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 550/1060] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 31 04:44:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:01.885159 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:01.885780 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:01.892973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:01.893448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:01.893915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:01.894576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:01.895147 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:01.895995 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:02.020657 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:02.031037 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e32ecf8f-8884-46f7-bb1f-cf3a120d9763 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1200 microversion: 2.1 time: 0.150270 Aug 31 04:44:02.031612 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 511/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:01 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1200 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:03.057126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:03.058516 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:03.088973 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:03.089747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:03.090370 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:03.091273 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:03.091881 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:03.092458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:03.390860 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:03.400789 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-c59e13da-d3a1-413f-839f-2f924ea55dde tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.348239 Aug 31 04:44:03.401712 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 551/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:03 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:03.451861 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c66ec1de-d5c8-4ad9-bb74-396dd166914c req-a665845a-5bfd-4835-a081-d052796b7f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31", "tag": "7bad20dd-2756-4449-9691-6e79374ebc0c"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:03.464799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c66ec1de-d5c8-4ad9-bb74-396dd166914c req-a665845a-5bfd-4835-a081-d052796b7f0b service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:03.465860 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c66ec1de-d5c8-4ad9-bb74-396dd166914c req-a665845a-5bfd-4835-a081-d052796b7f0b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:03.466849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c66ec1de-d5c8-4ad9-bb74-396dd166914c req-a665845a-5bfd-4835-a081-d052796b7f0b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:03.482094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c66ec1de-d5c8-4ad9-bb74-396dd166914c req-a665845a-5bfd-4835-a081-d052796b7f0b service nova] Creating event network-changed:7bad20dd-2756-4449-9691-6e79374ebc0c for instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 on hv-cinder-85530 Aug 31 04:44:03.487698 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c66ec1de-d5c8-4ad9-bb74-396dd166914c req-a665845a-5bfd-4835-a081-d052796b7f0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039612 Aug 31 04:44:03.488625 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 512/1063] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:03.545992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1565989728", "imageRef": "b473285d-a23f-4cc6-b71e-827d4082eb4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5e1d21-0d94-4325-a39c-d7a84e70a79f"}], "security_groups": [{"name": "tempest-securitygroup--1966842283"}], "key_name": "tempest-keypair-595217070", "user_data": "}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:03.663581 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.network.neutron [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] validate_networks() for [('9f5e1d21-0d94-4325-a39c-d7a84e70a79f', None, None, None, None, None)] {{(pid=127197) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:44:04.051897 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:44:04.052298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image limits 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:44:04.052770 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Flavor pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:44:04.053125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Image pref 0:0:0 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:44:04.053554 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.virt.hardware [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127197) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:44:04.063059 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:04.063769 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:04.064198 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:04.064920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:04.065363 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:04.065775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:04.083669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:44:04.089019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.quota [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Getting quotas for user 9f4dcda6ad1d401a9aed637906563d72 and project ae904e4b1df846e497cdf0edc46edaf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127197) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:44:04.106228 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Going to run 1 instances... {{(pid=127197) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:44:04.109065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b473285d-a23f-4cc6-b71e-827d4082eb4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127197) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:44:04.172848 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-535c236a-b0e0-47ee-89b6-81d6761b83c1 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630872 Aug 31 04:44:04.173889 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 552/1064] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:44:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:44:04.187638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-818bf82c-22fa-414a-8c5b-14868e062e42 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:04.188260 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-818bf82c-22fa-414a-8c5b-14868e062e42 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:04.256400 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-818bf82c-22fa-414a-8c5b-14868e062e42 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:04.263609 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-818bf82c-22fa-414a-8c5b-14868e062e42 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1241 microversion: 2.1 time: 0.080287 Aug 31 04:44:04.264379 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 513/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:04 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:04.421548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:04.422311 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:04.429524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:04.430083 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:04.430938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:04.431560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:04.432020 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:04.432576 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:04.585337 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:04.593515 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6c593af0-ecc6-4412-9dd8-5eded2a5fa75 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.175836 Aug 31 04:44:04.594105 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 553/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:04 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:05.284914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:05.285459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:05.293272 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:05.293782 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:05.294192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:05.294924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:05.295371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:05.295795 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:05.378542 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:05.387190 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-54eec13b-0371-4bd8-9e74-6619327116f3 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1301 microversion: 2.1 time: 0.106316 Aug 31 04:44:05.388015 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 514/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:05 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:05.617295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:05.618582 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:05.625440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:05.625920 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:05.626343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:05.627066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:05.627507 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:05.627945 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:05.765184 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:05.768734 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:05.774138 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-42a59b38-d192-425c-8017-6fe6ca6ff015 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.162589 Aug 31 04:44:05.774732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 554/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:05 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:06.409610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:06.410198 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:06.417085 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:06.417568 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:06.417985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:06.418671 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:06.419138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:06.419549 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:06.795819 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:06.796499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:06.803584 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:06.804290 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:06.804763 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:06.805530 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:06.806030 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:06.806445 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:06.852297 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:06.860138 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e1386a8-afa7-44ee-880c-80ea067f7b7a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1367 microversion: 2.1 time: 0.455407 Aug 31 04:44:06.860848 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 515/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:06 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1367 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:06.942503 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:06.950536 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-23ad1837-cd50-441d-b0d3-a1db0e99e266 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.159249 Aug 31 04:44:06.951145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 555/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:06 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:07.115996 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-6fdfb788-f4e6-4f2e-ad77-803adb7491e6 req-029c24f7-c8a2-4f40-b003-696aa664b41d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22114ebb-7cc7-4a6f-8851-f4a760764dad", "tag": "4d563b5e-4c7a-4b1c-8c9e-ed12f2081655"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:07.127465 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6fdfb788-f4e6-4f2e-ad77-803adb7491e6 req-029c24f7-c8a2-4f40-b003-696aa664b41d service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:07.127945 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6fdfb788-f4e6-4f2e-ad77-803adb7491e6 req-029c24f7-c8a2-4f40-b003-696aa664b41d service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:07.128366 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-6fdfb788-f4e6-4f2e-ad77-803adb7491e6 req-029c24f7-c8a2-4f40-b003-696aa664b41d service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:07.141485 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-6fdfb788-f4e6-4f2e-ad77-803adb7491e6 req-029c24f7-c8a2-4f40-b003-696aa664b41d service nova] Creating event network-changed:4d563b5e-4c7a-4b1c-8c9e-ed12f2081655 for instance 22114ebb-7cc7-4a6f-8851-f4a760764dad on hv-cinder-85530 Aug 31 04:44:07.146529 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-6fdfb788-f4e6-4f2e-ad77-803adb7491e6 req-029c24f7-c8a2-4f40-b003-696aa664b41d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035210 Aug 31 04:44:07.147391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 516/1071] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:07.886436 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:07.887361 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:07.898178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:07.898636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:07.899098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:07.899778 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:07.900224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:07.900636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:07.972244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:07.973023 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:07.980186 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:07.980692 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:07.981121 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:07.981809 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:07.982257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:07.982671 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:08.036028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:08.045182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f4e420e9-d4e3-408f-a9a9-096c8cbbe172 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1367 microversion: 2.1 time: 0.165718 Aug 31 04:44:08.045795 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 556/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:07 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:08.127326 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:08.135262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2b89e46f-a0a9-4c0e-9689-dfc218027db9 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.167277 Aug 31 04:44:08.135845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 517/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:07 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:09.066216 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:09.066917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:09.074306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:09.075216 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:09.075409 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:09.078651 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:09.078651 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:09.078880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:09.155936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:09.156543 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:09.163662 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:09.164139 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:09.164561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:09.165249 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:09.165689 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:09.166098 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:09.170330 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:09.217982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:09.226277 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d6dd4c79-ff75-4af6-94b6-d4ba55e9ef48 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1367 microversion: 2.1 time: 0.164219 Aug 31 04:44:09.239151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 557/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:09 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:09.296984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:09.305112 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-930c8fa2-43d0-4278-b0de-5f746c7c4f35 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.153160 Aug 31 04:44:09.305681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 518/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:09 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:44:10.249678 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:10.250357 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:10.260374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:10.261056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:10.261666 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:10.262636 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:10.263315 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:10.264002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:10.325715 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:10.326314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:10.333677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:10.334294 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:10.334869 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:10.335724 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:10.336163 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:10.336601 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:10.397224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:10.404901 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-52f1cf9c-f4bd-4afb-8dfa-870e7930b76b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1367 microversion: 2.1 time: 0.160953 Aug 31 04:44:10.405452 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 558/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:10 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:10.466151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:10.474290 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cf6fed01-417f-406a-9327-0cd91b4b3a63 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.152566 Aug 31 04:44:10.474896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 519/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:10 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:11.285991 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-c395cbba-5857-42e7-889b-4f831993e9da req-8b490aa0-4165-4f12-acaf-e4842fedf507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22114ebb-7cc7-4a6f-8851-f4a760764dad", "name": "network-vif-plugged", "status": "completed", "tag": "4d563b5e-4c7a-4b1c-8c9e-ed12f2081655"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:11.295203 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:11.300739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c395cbba-5857-42e7-889b-4f831993e9da req-8b490aa0-4165-4f12-acaf-e4842fedf507 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:11.301213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c395cbba-5857-42e7-889b-4f831993e9da req-8b490aa0-4165-4f12-acaf-e4842fedf507 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:11.302104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c395cbba-5857-42e7-889b-4f831993e9da req-8b490aa0-4165-4f12-acaf-e4842fedf507 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:11.315215 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-c395cbba-5857-42e7-889b-4f831993e9da req-8b490aa0-4165-4f12-acaf-e4842fedf507 service nova] Creating event network-vif-plugged:4d563b5e-4c7a-4b1c-8c9e-ed12f2081655 for instance 22114ebb-7cc7-4a6f-8851-f4a760764dad on hv-cinder-85530 Aug 31 04:44:11.320604 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-c395cbba-5857-42e7-889b-4f831993e9da req-8b490aa0-4165-4f12-acaf-e4842fedf507 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039163 Aug 31 04:44:11.321545 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 559/1078] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:11.427463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:11.428900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:11.436943 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:11.437691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:11.438280 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:11.439182 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:11.439772 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:11.440473 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:11.502547 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:11.504394 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:11.515391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:11.517372 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:11.518402 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:11.519499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:11.520469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:11.521131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:11.661500 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:11.662654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:11.670211 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0458e703-2593-4cbc-929b-3a2628a7c896 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.177656 Aug 31 04:44:11.671113 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 560/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:11 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:11.671617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2f3bad7e-6ff3-48b5-a710-8a84c3b8909b tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1367 microversion: 2.1 time: 0.249537 Aug 31 04:44:11.672278 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 520/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:11 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:12.691410 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:12.692117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:12.692491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:12.692592 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:12.699012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:12.699206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:12.699491 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:12.699650 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:12.699911 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:12.700083 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:12.700593 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:12.700740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:12.701028 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:12.701192 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:12.701419 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:12.701584 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:12.834740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:12.837081 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:12.843615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6305ca4e-efdc-4c0a-9519-5e5a30077807 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1367 microversion: 2.1 time: 0.155848 Aug 31 04:44:12.844117 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 521/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:12 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:12.845019 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a4792c77-e8de-4e5c-bcc3-357a1cf8efa6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.157535 Aug 31 04:44:12.845876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 561/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:12 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:13.339611 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-16dc000e-5a30-4e1d-a96e-f9f35879a5c0 req-c227fba3-c9c4-4775-9b24-1fb48f0254dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31", "name": "network-vif-plugged", "status": "completed", "tag": "7bad20dd-2756-4449-9691-6e79374ebc0c"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:13.350915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-16dc000e-5a30-4e1d-a96e-f9f35879a5c0 req-c227fba3-c9c4-4775-9b24-1fb48f0254dd service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:13.351382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-16dc000e-5a30-4e1d-a96e-f9f35879a5c0 req-c227fba3-c9c4-4775-9b24-1fb48f0254dd service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:13.351804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-16dc000e-5a30-4e1d-a96e-f9f35879a5c0 req-c227fba3-c9c4-4775-9b24-1fb48f0254dd service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:13.362886 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-16dc000e-5a30-4e1d-a96e-f9f35879a5c0 req-c227fba3-c9c4-4775-9b24-1fb48f0254dd service nova] Creating event network-vif-plugged:7bad20dd-2756-4449-9691-6e79374ebc0c for instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 on hv-cinder-85530 Aug 31 04:44:13.367780 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-16dc000e-5a30-4e1d-a96e-f9f35879a5c0 req-c227fba3-c9c4-4775-9b24-1fb48f0254dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Aug 31 04:44:13.368349 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 522/1083] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:13.867354 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:13.867961 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:13.868691 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:13.869380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:13.874733 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:13.875224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:13.875649 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:13.875810 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:13.876256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:13.876408 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:13.876678 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:13.876817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:13.877185 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:13.877321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:13.877792 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:13.878205 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:14.010638 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:14.014845 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:14.019170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6fad7fd6-2a08-4b4c-abf4-d234e2205291 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1558 microversion: 2.1 time: 0.157614 Aug 31 04:44:14.019746 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 562/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:13 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:14.023139 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-042025d0-2b03-497f-bef8-540e83fc750b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.160662 Aug 31 04:44:14.023710 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 523/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:13 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:14.040236 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:14.040726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:14.047102 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:14.047577 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:14.048003 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:14.048682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:14.049126 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:14.049536 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:14.072327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=4 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:14.098707 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=16 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:14.139340 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-97b58dcd-ae85-4207-a85d-83b660df9960 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102912 Aug 31 04:44:14.140077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 563/1086] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 31 04:44:14 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:44:15.044381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:15.044985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:15.047003 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:15.053681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:15.053681 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:15.054517 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:15.055258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:15.055887 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:15.056474 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:15.109374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-74b75860-839b-4d06-9951-fb6980b0f954 req-cfffaa28-36d6-48ef-8144-32737d980511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22114ebb-7cc7-4a6f-8851-f4a760764dad", "tag": "4d563b5e-4c7a-4b1c-8c9e-ed12f2081655"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:15.122699 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-74b75860-839b-4d06-9951-fb6980b0f954 req-cfffaa28-36d6-48ef-8144-32737d980511 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:15.123299 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-74b75860-839b-4d06-9951-fb6980b0f954 req-cfffaa28-36d6-48ef-8144-32737d980511 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:15.123983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-74b75860-839b-4d06-9951-fb6980b0f954 req-cfffaa28-36d6-48ef-8144-32737d980511 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:15.137432 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-74b75860-839b-4d06-9951-fb6980b0f954 req-cfffaa28-36d6-48ef-8144-32737d980511 service nova] Creating event network-changed:4d563b5e-4c7a-4b1c-8c9e-ed12f2081655 for instance 22114ebb-7cc7-4a6f-8851-f4a760764dad on hv-cinder-85530 Aug 31 04:44:15.142902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-74b75860-839b-4d06-9951-fb6980b0f954 req-cfffaa28-36d6-48ef-8144-32737d980511 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037825 Aug 31 04:44:15.146231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 564/1087] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:15.217256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:15.227911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3840f0d6-6812-401e-90a1-5de5391fb719 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1266 microversion: 2.1 time: 0.187352 Aug 31 04:44:15.229426 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 524/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:15 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:16.254262 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:16.254866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:16.264055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:16.264535 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:16.264962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:16.265723 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:16.266186 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:16.266605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:16.413917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:16.426287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7b145c2e-89ff-45c5-b47d-85d9324b5099 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1453 microversion: 2.1 time: 0.179481 Aug 31 04:44:16.427187 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 565/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:16 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:16.452957 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:16.453573 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:16.456014 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:16.461689 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:16.462168 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:16.462595 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:16.463345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:16.463786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:16.464233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:16.613136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:16.626064 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7f3eaea2-294d-4ef9-8893-e543aaf29c26 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1453 microversion: 2.1 time: 0.176691 Aug 31 04:44:16.626668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 525/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:16 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:18.302050 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-09405325-4409-40ef-a16d-c6b23bfd8353 req-83dc97b0-545a-4b69-b475-668985502ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31", "tag": "7bad20dd-2756-4449-9691-6e79374ebc0c"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:18.311748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-09405325-4409-40ef-a16d-c6b23bfd8353 req-83dc97b0-545a-4b69-b475-668985502ce5 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:18.312212 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-09405325-4409-40ef-a16d-c6b23bfd8353 req-83dc97b0-545a-4b69-b475-668985502ce5 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:18.312628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-09405325-4409-40ef-a16d-c6b23bfd8353 req-83dc97b0-545a-4b69-b475-668985502ce5 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:18.325423 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-09405325-4409-40ef-a16d-c6b23bfd8353 req-83dc97b0-545a-4b69-b475-668985502ce5 service nova] Creating event network-changed:7bad20dd-2756-4449-9691-6e79374ebc0c for instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 on hv-cinder-85530 Aug 31 04:44:18.330229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-09405325-4409-40ef-a16d-c6b23bfd8353 req-83dc97b0-545a-4b69-b475-668985502ce5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031859 Aug 31 04:44:18.331563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 566/1091] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:47.540660 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:47.541205 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:47.543284 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:47.543949 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=42 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:47.550139 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:47.550593 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:47.551071 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:47.551762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:47.552207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:47.552623 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:47.577566 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0799213d-63bd-475d-94f9-bf2d2b89fec0 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/ips" status: 200 len: 150 microversion: 2.1 time: 0.041541 Aug 31 04:44:47.578141 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 526/1092] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:44:47 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:48.937626 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=14 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:48.938362 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=58 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:48.942831 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c0d80a3-463f-4605-aca1-8b971c376994"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:48.945246 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:48.952612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:48.953085 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:48.953511 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:48.954188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:48.954626 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:48.955060 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:49.235231 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1852d6e3-3a88-43a8-9d5b-cf7d111775f9 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "POST /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299013 Aug 31 04:44:49.235833 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 567/1093] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 31 04:44:48 2022] POST /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:44:56.934907 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:56.935439 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:56.943231 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:56.943708 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:56.944141 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:56.944815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:56.945627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:56.946040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:57.257008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lazy-loading 'services' on Instance uuid 22114ebb-7cc7-4a6f-8851-f4a760764dad {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:44:57.334505 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-29050079-da83-449d-98ab-1ffb7677ef39 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments/9c0d80a3-463f-4605-aca1-8b971c376994" status: 202 len: 0 microversion: 2.1 time: 0.403543 Aug 31 04:44:57.335132 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 527/1094] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 31 04:44:56 2022] DELETE /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments/9c0d80a3-463f-4605-aca1-8b971c376994 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:44:57.344280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:57.346635 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:57.353551 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:57.354167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:57.354594 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:57.355306 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:57.355742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:57.356151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:57.386674 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-26edd08c-01f4-4e01-a4a3-18aa0ceef49a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046683 Aug 31 04:44:57.387259 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 568/1095] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:44:57 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:58.403707 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:58.406010 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:58.413449 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:58.413920 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:58.414296 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:58.414996 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:58.415464 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:58.416231 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:58.446793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f7bb0988-8d42-47a2-9670-ab738f64cbc7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049618 Aug 31 04:44:58.447355 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 528/1096] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:44:58 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:44:58.502605 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:44:58.503196 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:58.510548 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:58.511013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:58.511440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:58.512139 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:58.512826 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:58.513247 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:58.540487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.objects.instance [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lazy-loading 'flavor' on Instance uuid 3339d1f4-1f06-4585-aba3-ed352579d75a {{(pid=127197) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:44:58.622952 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2a927f66-710d-4a31-a9db-2166909ce9a6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "POST /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a/action" status: 202 len: 0 microversion: 2.1 time: 0.124185 Aug 31 04:44:58.623566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 569/1097] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:44:58 2022] POST /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:44:58.631989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:58.632615 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:58.639000 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:58.639610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:58.640180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:58.641040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:58.641654 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:58.642101 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:58.789527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:58.798672 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7da71201-6a80-481e-aeef-5757c1eb4395 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.170473 Aug 31 04:44:58.799279 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 529/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:58 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:44:59.465109 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:59.468537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:59.478226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.479023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.479561 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.480273 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.480822 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.481379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.512062 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a367875d-c4ea-492a-8c31-3239ef6203ac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055183 Aug 31 04:44:59.512835 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 570/1099] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 31 04:44:59 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:44:59.586510 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:59.587081 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:59.596350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.597025 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.597624 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.598650 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.599356 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.599868 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.627012 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:44:59.711160 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b5bbb2c6-fb8b-472b-bc68-fb6bf3237efe tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 204 len: 0 microversion: 2.1 time: 0.130452 Aug 31 04:44:59.711831 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 530/1100] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:44:59 2022] DELETE /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:44:59.720386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:59.720900 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:59.727568 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.728044 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.728466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.729326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.729748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.730381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.821728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:44:59.822749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:44:59.829054 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.829542 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.829973 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.830669 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:44:59.831146 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:44:59.831564 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:44:59.922647 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:59.930532 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-084ccb33-83da-4b27-b1f5-8aeda3da516d tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1682 microversion: 2.1 time: 0.214171 Aug 31 04:44:59.931103 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 571/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:59 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:44:59.962959 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:44:59.971883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-298eff95-bfb5-48d1-a081-5d9860273038 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.154875 Aug 31 04:44:59.972376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 531/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:44:59 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:00.957892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:00.959023 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:00.969905 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:00.970693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:00.971455 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:00.972595 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:00.973327 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:00.974010 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:00.993586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:00.994963 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:01.001759 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:01.002327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:01.002749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:01.003488 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:01.003977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:01.004389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:01.111691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:01.119318 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ba9fc83b-5628-4cbc-b4ea-67b7967f621e tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1682 microversion: 2.1 time: 0.168147 Aug 31 04:45:01.119880 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 572/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:00 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:01.142226 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:01.150132 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0619cc3c-2922-4592-8ab1-5e39ad06a01d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.160532 Aug 31 04:45:01.150744 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 532/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:00 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:02.141158 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:02.141835 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:02.148260 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:02.148732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:02.149155 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:02.149837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:02.150275 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:02.150996 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:02.173985 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:02.175438 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:02.184249 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:02.184828 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:02.185360 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:02.186099 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:02.186829 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:02.187298 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:02.241258 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:02.250444 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9edf804f-34be-4a61-8fa5-44a5fff7f26a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1614 microversion: 2.1 time: 0.113185 Aug 31 04:45:02.251055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 573/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:02 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:02.413311 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:02.423927 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-47fa552d-4967-40f1-b5bc-f8e37b8f5b89 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.256175 Aug 31 04:45:02.424682 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 533/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:02 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:45:02.608772 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-42754c66-c9e2-4e2d-a4a8-03a4ac1bb76b req-75437f98-3121-4da5-a10f-96a982157f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22114ebb-7cc7-4a6f-8851-f4a760764dad", "name": "network-vif-deleted", "tag": "4d563b5e-4c7a-4b1c-8c9e-ed12f2081655"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:02.619485 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-42754c66-c9e2-4e2d-a4a8-03a4ac1bb76b req-75437f98-3121-4da5-a10f-96a982157f2b service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:02.620209 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-42754c66-c9e2-4e2d-a4a8-03a4ac1bb76b req-75437f98-3121-4da5-a10f-96a982157f2b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:02.620649 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-42754c66-c9e2-4e2d-a4a8-03a4ac1bb76b req-75437f98-3121-4da5-a10f-96a982157f2b service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:02.645926 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-42754c66-c9e2-4e2d-a4a8-03a4ac1bb76b req-75437f98-3121-4da5-a10f-96a982157f2b service nova] Creating event network-vif-deleted:4d563b5e-4c7a-4b1c-8c9e-ed12f2081655 for instance 22114ebb-7cc7-4a6f-8851-f4a760764dad on hv-cinder-85530 Aug 31 04:45:02.651563 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-42754c66-c9e2-4e2d-a4a8-03a4ac1bb76b req-75437f98-3121-4da5-a10f-96a982157f2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047283 Aug 31 04:45:02.652168 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 574/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:03.273463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:03.274073 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:03.281835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:03.282327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:03.282896 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:03.283867 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:03.284382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:03.284872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:03.323574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:03.324184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:03.324648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:03.325179 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lazy-loading 'fault' on Instance uuid 22114ebb-7cc7-4a6f-8851-f4a760764dad {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:45:03.367754 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4dcda6ad1d401a9aed637906563d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae904e4b1df846e497cdf0edc46edaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:03.375886 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9b4192d2-62ae-4b6e-8b2b-3890f35ea796 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 200 len: 1331 microversion: 2.1 time: 0.106372 Aug 31 04:45:03.376462 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 534/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:03 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:03.449001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:03.449689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:03.456353 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:03.456833 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:03.457251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:03.457943 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:03.458381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:03.458805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:03.598483 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:03.606821 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-99def152-f344-4abe-9ab5-e744a6404ac3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.163174 Aug 31 04:45:03.607523 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 575/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:03 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:04.400736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:04.401256 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:04.408328 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:04.408800 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:04.409225 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:04.409915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:04.410354 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:04.410811 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:04.424650 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad HTTP/1.1 Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:45:04.426283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:04.427924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '22114ebb-7cc7-4a6f-8851-f4a760764dad'} Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:04.428798 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:04.430067 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:04.431314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:04.431314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7033622c-cdbf-4c75-8251-efecaf786a6f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 404 len: 111 microversion: 2.1 time: 0.033414 Aug 31 04:45:04.431314 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 535/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:04 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:04.437089 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d1e70541-f268-4401-bc98-c3562d36bc37 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '.version_select at 0x7fc8271224c0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:04.459037 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d1e70541-f268-4401-bc98-c3562d36bc37 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595217070" status: 202 len: 0 microversion: 2.1 time: 0.025757 Aug 31 04:45:04.459710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 576/1111] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 31 04:45:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595217070 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:45:04.628063 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:04.628674 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:04.634949 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:04.635380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:04.635804 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:04.636481 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:04.636924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:04.637432 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:04.774459 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:04.782532 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-89a4aa10-ee23-4e2f-983e-6a26f335390b tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.158370 Aug 31 04:45:04.783173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 536/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:04 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:05.805032 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:05.805634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:05.812504 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:05.812974 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:05.813393 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:05.814063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:05.814502 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:05.814967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:05.961425 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:05.970100 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-8d588dd3-9250-436f-a47b-3dd9c3371705 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.169593 Aug 31 04:45:05.970662 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 577/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:05 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:06.244635 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:06.245164 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:06.251914 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:06.252388 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:06.252806 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:06.253524 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:06.253965 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:06.254376 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:06.267706 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad HTTP/1.1 Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:45:06.269244 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.270835 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '22114ebb-7cc7-4a6f-8851-f4a760764dad'} Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:06.271732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.273184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.274977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:06.274977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8aac952b-6383-4007-b99a-4337061c2071 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 404 len: 111 microversion: 2.1 time: 0.030349 Aug 31 04:45:06.274977 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 537/1114] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:45:06 2022] DELETE /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:06.279689 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:06.280298 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 22114ebb-7cc7-4a6f-8851-f4a760764dad] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:06.286537 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:06.287055 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:06.287476 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:06.288163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:06.288609 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:06.289025 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:06.302555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad HTTP/1.1 Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:45:06.304221 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.305718 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '22114ebb-7cc7-4a6f-8851-f4a760764dad'} Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:06.306585 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. Aug 31 04:45:06.307907 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:06.309012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 22114ebb-7cc7-4a6f-8851-f4a760764dad could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:06.309012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-58f67d0c-438a-4d37-9a7a-75cfbbb6419a tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad" status: 404 len: 111 microversion: 2.1 time: 0.030128 Aug 31 04:45:06.309012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 578/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:06 2022] GET /compute/v2.1/servers/22114ebb-7cc7-4a6f-8851-f4a760764dad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:06.995868 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:06.996747 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:07.007098 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.007895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.008610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.009899 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.010496 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.010949 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.147641 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:07.155960 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8cf22aae-165e-4fc5-900b-3fedd9dd854d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.167461 Aug 31 04:45:07.156528 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 538/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:06 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:07.473324 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:07.473841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:07.481002 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.481466 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.481885 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.482566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.483037 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.483448 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.497092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b HTTP/1.1 Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:45:07.498628 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.500217 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '7bc8b1ad-a81b-474b-90c3-d51d4e2c693b'} Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:07.501294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.502811 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.504297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:07.504297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-53f63fcd-aa88-4069-b828-8b97f639a7e4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 404 len: 111 microversion: 2.1 time: 0.030657 Aug 31 04:45:07.504297 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 579/1117] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:45:07 2022] DELETE /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:07.508567 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:07.509215 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:07.517327 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.517812 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.518243 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.518975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.519430 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.519853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.534008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b HTTP/1.1 Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:45:07.535604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.537143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '7bc8b1ad-a81b-474b-90c3-d51d4e2c693b'} Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:07.537938 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. Aug 31 04:45:07.539173 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.540237 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 7bc8b1ad-a81b-474b-90c3-d51d4e2c693b could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:07.540237 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cadfd4a1-0f50-4686-9deb-63e6d82d8be7 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b" status: 404 len: 111 microversion: 2.1 time: 0.032370 Aug 31 04:45:07.540237 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 539/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:07 2022] GET /compute/v2.1/servers/7bc8b1ad-a81b-474b-90c3-d51d4e2c693b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:07.546025 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:07.546514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:07.552710 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.553178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.553588 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.554266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.554704 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.555151 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.569088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: DELETE /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea HTTP/1.1 Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:45:07.570634 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.572389 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': 'abb58876-fcb0-48d7-a852-830fb79567ea'} Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:07.573178 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.574827 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.576440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:07.576440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6e91aa39-6725-4561-9cb9-2bb40606eeac tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 404 len: 111 microversion: 2.1 time: 0.030291 Aug 31 04:45:07.576440 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 580/1119] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:45:07 2022] DELETE /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:07.581193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:07.581803 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: abb58876-fcb0-48d7-a852-830fb79567ea] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:07.588337 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.589358 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.589793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.590487 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:07.590972 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:07.591394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:07.606143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea HTTP/1.1 Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:45:07.607690 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.609262 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': 'abb58876-fcb0-48d7-a852-830fb79567ea'} Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:07.610142 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. Aug 31 04:45:07.611498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:07.612785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance abb58876-fcb0-48d7-a852-830fb79567ea could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:07.612785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ab0d8b60-1e4f-478e-84db-7a6f372c4641 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea" status: 404 len: 111 microversion: 2.1 time: 0.031765 Aug 31 04:45:07.612785 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 540/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:07 2022] GET /compute/v2.1/servers/abb58876-fcb0-48d7-a852-830fb79567ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:08.183971 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:08.184608 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:08.191569 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:08.192061 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:08.192861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:08.193576 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:08.194038 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:08.194470 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:08.332526 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:08.340414 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ad1772a2-2445-42ab-8940-ecaa64b6b976 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.162458 Aug 31 04:45:08.340950 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 581/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:08 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:08.755012 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:08.755540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:08.762677 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:08.763207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:08.763650 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:08.764345 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:08.764791 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:08.765203 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:08.779201 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb HTTP/1.1 Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:45:08.780840 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.782389 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '367213be-b6d0-4465-ab62-f280b288b2fb'} Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:08.783234 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.784667 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.786022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:08.786022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fe4aef30-c743-4e3a-8b72-a4e31366b4f4 tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "DELETE /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 404 len: 111 microversion: 2.1 time: 0.031269 Aug 31 04:45:08.786022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 541/1122] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:45:08 2022] DELETE /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:08.790863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:08.791499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] [instance: 367213be-b6d0-4465-ab62-f280b288b2fb] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:08.798552 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:08.799063 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:08.799489 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:08.800173 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:08.800614 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:08.801032 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:08.816170 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] HTTP exception thrown: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Request method failure captured: Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb HTTP/1.1 Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZJufyQZ7eFFEkU14iOkhs96LVHlEzR8otRM9kDk4e8aCBGV4YvRaZ5IId4KiCVmi3FL_3s5Ufg5yqe5Cs5SO6PC7XAEMWL2fVoF-2Jbu-frcUVUrxzHDP2ZcdmmFsDMOWGZNwHzRLg0qZiDeOTI22TRm8RQvF70N0spZQ0CZyrcDA Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:45:08.818065 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae904e4b1df846e497cdf0edc46edaf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae904e4b1df846e497cdf0edc46edaf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae904e4b1df846e497cdf0edc46edaf1"}]}] Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: ae904e4b1df846e497cdf0edc46edaf1 Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367803207 Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 9f4dcda6ad1d401a9aed637906563d72 Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-AttachVolumeNegativeTest-1367803207-project Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.819610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '367213be-b6d0-4465-ab62-f280b288b2fb'} Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:08.820492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. Aug 31 04:45:08.821902 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:08.823426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] Returning 404 to user: Instance 367213be-b6d0-4465-ab62-f280b288b2fb could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:08.823426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a6dfe93b-1647-4faa-9909-48b51b3e267f tempest-AttachVolumeNegativeTest-1367803207 tempest-AttachVolumeNegativeTest-1367803207-project] 10.222.0.42 "GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb" status: 404 len: 111 microversion: 2.1 time: 0.032683 Aug 31 04:45:08.823426 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 582/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:08 2022] GET /compute/v2.1/servers/367213be-b6d0-4465-ab62-f280b288b2fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:45:09.361758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:09.363442 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:09.369491 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:09.369967 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:09.370384 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:09.371120 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:09.371762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:09.372367 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:09.577552 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:09.586299 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-407f561d-c962-4eaf-99c2-994f1b8cd217 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.228319 Aug 31 04:45:09.586933 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 542/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:09 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:10.608469 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:10.609101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:10.615839 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:10.616284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:10.616737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:10.617454 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:10.617892 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:10.618271 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:10.831686 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:10.842026 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-cc2e69e4-b6a2-4f89-84f5-88d7b709d0f8 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.237294 Aug 31 04:45:10.848326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 583/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:10 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:11.864463 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:11.865912 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:11.873026 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:11.873854 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:11.874512 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:11.875806 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:11.876948 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:11.877940 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:11.900038 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:12.124380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:12.133364 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-841f50ae-0115-42dd-ae42-8e2ff0ffc46a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1570 microversion: 2.1 time: 0.273341 Aug 31 04:45:12.134130 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 543/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:11 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1570 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:12.155144 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:12.156422 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:12.163167 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:12.163844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:12.164439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:12.165287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:12.165877 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:12.166439 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:12.184381 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:12.199691 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127197) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 04:45:12.288229 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e9513f49-5f5a-45de-a766-89277182ce75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "POST /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a/action" status: 202 len: 0 microversion: 2.1 time: 0.137126 Aug 31 04:45:12.288834 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 584/1127] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 31 04:45:12 2022] POST /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:45:12.297136 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:12.298044 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:12.304439 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:12.304915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:12.305333 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:12.308350 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:12.308827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:12.309247 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:12.468207 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:12.476346 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7ed30fb2-1e2f-4664-bde1-de87846a931c tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1518 microversion: 2.1 time: 0.183035 Aug 31 04:45:12.476757 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 544/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:12 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:13.497978 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:13.498572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:13.505878 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:13.506469 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:13.507174 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:13.509742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-af7426b5-5364-4de7-8589-5b03d8eb0f1c tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Action: 'create', calling method: .version_select at 0x7fc827155310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1862810288"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:13.511158 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:13.511733 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:13.512151 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:13.656419 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:13.667218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b5818ef6-1d08-4c51-958a-c66dc1cf4c2e tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1520 microversion: 2.1 time: 0.173140 Aug 31 04:45:13.668134 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 545/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:13 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:13.844249 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-af7426b5-5364-4de7-8589-5b03d8eb0f1c tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.451469 Aug 31 04:45:13.844940 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 585/1130] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Aug 31 04:45:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 453 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 04:45:13.858820 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-de568883-9c51-4df5-9361-535a84098d9d tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc827111700>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:13.910600 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-de568883-9c51-4df5-9361-535a84098d9d tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f" status: 200 len: 345 microversion: 2.1 time: 0.056965 Aug 31 04:45:13.911504 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 546/1131] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:13 2022] GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:14.689164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:14.689652 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:14.697737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:14.698308 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:14.698748 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:14.699453 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:14.699890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:14.700300 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:14.831295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:14.839514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ae8fa10d-3b44-4076-855b-37ccb0b5989a tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1576 microversion: 2.1 time: 0.154902 Aug 31 04:45:14.840080 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 586/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:14 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:14.929104 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a4896f2a-0841-4e80-bd9e-373a821bd415 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc8270675e0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:14.981636 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a4896f2a-0841-4e80-bd9e-373a821bd415 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f" status: 200 len: 346 microversion: 2.1 time: 0.059775 Aug 31 04:45:14.982209 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 547/1133] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:14 2022] GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:14.994775 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-eea03bda-be44-4072-81d4-ad928f09a23b tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Action: 'create', calling method: .version_select at 0x7fc82a88d040>, body: {"snapshot": {"volume_id": "6791383b-1554-401a-8a55-db0a7039ef0f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-424627992"}} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:15.158972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-eea03bda-be44-4072-81d4-ad928f09a23b tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.168144 Aug 31 04:45:15.164849 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 587/1134] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Aug 31 04:45:14 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:15.170555 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fbc9c7e4-b924-4c81-b234-46cd1f6dc3d6 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc826e318b0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:15.202390 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fbc9c7e4-b924-4c81-b234-46cd1f6dc3d6 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 200 len: 286 microversion: 2.1 time: 0.035898 Aug 31 04:45:15.203180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 548/1135] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 04:45:15 2022] GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:15.214837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3296b042-28eb-4c76-9348-99daeeeddbc0 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc82a81b3a0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:15.245759 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3296b042-28eb-4c76-9348-99daeeeddbc0 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035248 Aug 31 04:45:15.246373 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 588/1136] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 31 04:45:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:15.257627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-21122662-4d8c-441a-969d-9e4008a49cad tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc827067820>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:15.259518 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-c02e7a6a-76b3-40c7-a657-a2879220ea79 req-eab15caa-da0e-4d9b-8de3-74fdb2f7e047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3339d1f4-1f06-4585-aba3-ed352579d75a", "name": "network-vif-unplugged", "status": "completed", "tag": "ae65d506-d89f-4468-a25b-cf6f8e85f73e"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:15.273814 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c02e7a6a-76b3-40c7-a657-a2879220ea79 req-eab15caa-da0e-4d9b-8de3-74fdb2f7e047 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:15.274281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c02e7a6a-76b3-40c7-a657-a2879220ea79 req-eab15caa-da0e-4d9b-8de3-74fdb2f7e047 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:15.274919 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-c02e7a6a-76b3-40c7-a657-a2879220ea79 req-eab15caa-da0e-4d9b-8de3-74fdb2f7e047 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:15.286082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-c02e7a6a-76b3-40c7-a657-a2879220ea79 req-eab15caa-da0e-4d9b-8de3-74fdb2f7e047 service nova] Creating event network-vif-unplugged:ae65d506-d89f-4468-a25b-cf6f8e85f73e for instance 3339d1f4-1f06-4585-aba3-ed352579d75a on hv-cinder-85530 Aug 31 04:45:15.289065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-21122662-4d8c-441a-969d-9e4008a49cad tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 200 len: 286 microversion: 2.1 time: 0.035505 Aug 31 04:45:15.291850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-c02e7a6a-76b3-40c7-a657-a2879220ea79 req-eab15caa-da0e-4d9b-8de3-74fdb2f7e047 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035539 Aug 31 04:45:15.292380 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 549/1137] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 04:45:15 2022] GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:15.292669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 589/1138] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:15.863258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:15.864103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:15.872497 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:15.873126 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:15.873727 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:15.874586 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:15.875219 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:15.875766 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:16.013158 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:16.024789 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b635f58d-3592-4f4b-a1e8-ada899e112c3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1576 microversion: 2.1 time: 0.167209 Aug 31 04:45:16.025581 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 550/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:15 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:16.307812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-59a72934-3c69-40e2-ae93-3f287eb7636b tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc827062160>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:16.338908 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-59a72934-3c69-40e2-ae93-3f287eb7636b tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 200 len: 286 microversion: 2.1 time: 0.037867 Aug 31 04:45:16.339458 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 590/1140] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 04:45:16 2022] GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:17.055661 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:17.056734 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:17.064189 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:17.064696 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:17.065565 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:17.066232 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:17.066752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:17.067193 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:17.213868 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:17.222065 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2a85d205-7b53-43d3-ad83-f279f2984ae6 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1576 microversion: 2.1 time: 0.173380 Aug 31 04:45:17.222610 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 551/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:17 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:17.355990 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a3b58dc3-37b7-4389-a849-9a215c308ef1 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc8270e09d0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:17.388804 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a3b58dc3-37b7-4389-a849-9a215c308ef1 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 200 len: 286 microversion: 2.1 time: 0.038794 Aug 31 04:45:17.389586 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 591/1142] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 04:45:17 2022] GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:18.250915 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:18.251530 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:18.253939 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:18.259989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:18.260477 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:18.260908 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:18.261597 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:18.262042 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:18.262454 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:18.401962 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:18.405566 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e38a595c-b9a4-4e9e-920c-8d5decad1163 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc82a8beb80>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:18.413947 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bbeed65d-edba-4e26-b9af-3f3c7330ac0d tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1576 microversion: 2.1 time: 0.166783 Aug 31 04:45:18.414750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 552/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:18 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:18.442587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e38a595c-b9a4-4e9e-920c-8d5decad1163 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 200 len: 287 microversion: 2.1 time: 0.044718 Aug 31 04:45:18.443268 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 592/1144] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 04:45:18 2022] GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:18.454191 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f0852a23-551e-4bf6-bc84-98e2a727b4ae tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc82708fca0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:18.519046 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f0852a23-551e-4bf6-bc84-98e2a727b4ae tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 202 len: 0 microversion: 2.1 time: 0.068513 Aug 31 04:45:18.519675 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 553/1145] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Aug 31 04:45:18 2022] DELETE /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:45:18.530474 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b6e4044e-cf5d-4b8e-aac8-efc35dcd8c16 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc8270e03a0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:18.562182 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b6e4044e-cf5d-4b8e-aac8-efc35dcd8c16 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 200 len: 286 microversion: 2.1 time: 0.035613 Aug 31 04:45:18.562805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 593/1146] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 04:45:18 2022] GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:19.440978 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:19.441913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:19.452249 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:19.453040 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:19.453748 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:19.454924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:19.455671 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:19.456365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:19.576251 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7d8ad64e-1efa-4aa6-b7d4-3243709731d7 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc827062160>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:19.600830 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:19.602697 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-7d8ad64e-1efa-4aa6-b7d4-3243709731d7 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] HTTP exception thrown: Snapshot f2476595-88fe-49ac-82ce-1dff9a2eeb94 could not be found. Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7d8ad64e-1efa-4aa6-b7d4-3243709731d7 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Request method failure captured: Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 HTTP/1.1 Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDudZDqsulTnTvc-H3fvkUKzLYx7WazknQsfV81wa-drn9auYa166aTo696TkGJgbc-JgE2OENEv1tMS5IDpgxqrNUGYSY6LbYVpiq0-xYXyY99PguZMLpT3hFVuxh3wm9KMhn4Eoh1oeXtIY4MB2mz0PFjo2PTWN2m3aYaEn2v6654c Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:45:19.605252 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_09961741edfa42288307bfe2f406578d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/09961741edfa42288307bfe2f406578d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}] Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 201721f1cf9041619f04df9304ceb736 Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Snapshot f2476595-88fe-49ac-82ce-1dff9a2eeb94 could not be found. Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': 'f2476595-88fe-49ac-82ce-1dff9a2eeb94'} Aug 31 04:45:19.606918 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f2476595-88fe-49ac-82ce-1dff9a2eeb94 could not be found. (HTTP 404) (Request-ID: req-5e0253be-409c-4396-be36-77beb6a17950) Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:19.607850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:45:19.609130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f2476595-88fe-49ac-82ce-1dff9a2eeb94 could not be found. Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 04:45:19.611191 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f2476595-88fe-49ac-82ce-1dff9a2eeb94 could not be found. Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f2476595-88fe-49ac-82ce-1dff9a2eeb94 could not be found. Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7d8ad64e-1efa-4aa6-b7d4-3243709731d7 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Returning 404 to user: Snapshot f2476595-88fe-49ac-82ce-1dff9a2eeb94 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:19.613165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7d8ad64e-1efa-4aa6-b7d4-3243709731d7 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94" status: 404 len: 111 microversion: 2.1 time: 0.035151 Aug 31 04:45:19.614833 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 594/1147] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 31 04:45:19 2022] GET /compute/v2.1/os-snapshots/f2476595-88fe-49ac-82ce-1dff9a2eeb94 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:19.614937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6ec04de5-40c5-4b0b-9485-cab2d55da3e3 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1576 microversion: 2.1 time: 0.180380 Aug 31 04:45:19.614937 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 554/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:19 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:19.620747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-af60fcba-c0d9-47f9-aa32-6226690205dc tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc82a852820>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:19.685280 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-af60fcba-c0d9-47f9-aa32-6226690205dc tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f" status: 202 len: 0 microversion: 2.1 time: 0.073510 Aug 31 04:45:19.685850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 595/1149] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:45:19 2022] DELETE /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 04:45:19.696926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-82981ba3-36c4-4646-a0ae-a67a86b2abcc tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc826fae940>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:19.743668 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-82981ba3-36c4-4646-a0ae-a67a86b2abcc tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f" status: 200 len: 345 microversion: 2.1 time: 0.052517 Aug 31 04:45:19.744239 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 555/1150] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:19 2022] GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:20.638131 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:20.638866 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:20.640868 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:20.646560 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:20.647092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:20.647514 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:20.648246 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:20.648685 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:20.649101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:20.757603 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0650542a-4c8e-4433-a503-42d18afb2684 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc8272f4310>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:20.789114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:20.791197 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-0650542a-4c8e-4433-a503-42d18afb2684 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] HTTP exception thrown: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0650542a-4c8e-4433-a503-42d18afb2684 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Request method failure captured: Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f HTTP/1.1 Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDudZDqsulTnTvc-H3fvkUKzLYx7WazknQsfV81wa-drn9auYa166aTo696TkGJgbc-JgE2OENEv1tMS5IDpgxqrNUGYSY6LbYVpiq0-xYXyY99PguZMLpT3hFVuxh3wm9KMhn4Eoh1oeXtIY4MB2mz0PFjo2PTWN2m3aYaEn2v6654c Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:45:20.793322 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_09961741edfa42288307bfe2f406578d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/09961741edfa42288307bfe2f406578d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}] Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 201721f1cf9041619f04df9304ceb736 Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '6791383b-1554-401a-8a55-db0a7039ef0f'} Aug 31 04:45:20.794786 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. (HTTP 404) (Request-ID: req-02ebe0b6-5ae5-4eac-83ba-d429af901730) Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.796206 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:45:20.797394 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:45:20.798578 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0650542a-4c8e-4433-a503-42d18afb2684 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Returning 404 to user: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0650542a-4c8e-4433-a503-42d18afb2684 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f" status: 404 len: 109 microversion: 2.1 time: 0.041305 Aug 31 04:45:20.801645 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 556/1151] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:20 2022] GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:20.803580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-beea7ac7-5043-4f7f-b0c0-513963259ac1 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1576 microversion: 2.1 time: 0.165388 Aug 31 04:45:20.809600 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-09a8a9a6-384b-4f56-bdcf-26ec05c1f397 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc82746a040>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:20.811732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 596/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:20 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:20.837991 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-09a8a9a6-384b-4f56-bdcf-26ec05c1f397 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] HTTP exception thrown: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-09a8a9a6-384b-4f56-bdcf-26ec05c1f397 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Request method failure captured: Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f HTTP/1.1 Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDudZDqsulTnTvc-H3fvkUKzLYx7WazknQsfV81wa-drn9auYa166aTo696TkGJgbc-JgE2OENEv1tMS5IDpgxqrNUGYSY6LbYVpiq0-xYXyY99PguZMLpT3hFVuxh3wm9KMhn4Eoh1oeXtIY4MB2mz0PFjo2PTWN2m3aYaEn2v6654c Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:45:20.841498 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_09961741edfa42288307bfe2f406578d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/09961741edfa42288307bfe2f406578d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}] Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 201721f1cf9041619f04df9304ceb736 Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '6791383b-1554-401a-8a55-db0a7039ef0f'} Aug 31 04:45:20.843149 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. (HTTP 404) (Request-ID: req-bec5105b-ff3f-4f3b-b273-2e6a589d7755) Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.844061 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:45:20.845238 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 04:45:20.846377 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-09a8a9a6-384b-4f56-bdcf-26ec05c1f397 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Returning 404 to user: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-09a8a9a6-384b-4f56-bdcf-26ec05c1f397 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f" status: 404 len: 109 microversion: 2.1 time: 0.041006 Aug 31 04:45:20.847701 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 557/1153] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 31 04:45:20 2022] DELETE /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:20.853747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a759a1b6-16cb-45c8-bad7-4b48537afae8 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Calling method '.version_select at 0x7fc827cd94c0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:20.883303 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-a759a1b6-16cb-45c8-bad7-4b48537afae8 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] HTTP exception thrown: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a759a1b6-16cb-45c8-bad7-4b48537afae8 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Request method failure captured: Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f HTTP/1.1 Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDudZDqsulTnTvc-H3fvkUKzLYx7WazknQsfV81wa-drn9auYa166aTo696TkGJgbc-JgE2OENEv1tMS5IDpgxqrNUGYSY6LbYVpiq0-xYXyY99PguZMLpT3hFVuxh3wm9KMhn4Eoh1oeXtIY4MB2mz0PFjo2PTWN2m3aYaEn2v6654c Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:45:20.885498 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_09961741edfa42288307bfe2f406578d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/09961741edfa42288307bfe2f406578d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/09961741edfa42288307bfe2f406578d"}]}] Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 09961741edfa42288307bfe2f406578d Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491867635 Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: 201721f1cf9041619f04df9304ceb736 Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491867635-project Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '6791383b-1554-401a-8a55-db0a7039ef0f'} Aug 31 04:45:20.887015 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. (HTTP 404) (Request-ID: req-8e42a8e4-6792-40c4-a9d0-6edc3ea9e4e1) Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.887967 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:45:20.889481 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:45:20.890863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a759a1b6-16cb-45c8-bad7-4b48537afae8 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] Returning 404 to user: Volume 6791383b-1554-401a-8a55-db0a7039ef0f could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a759a1b6-16cb-45c8-bad7-4b48537afae8 tempest-VolumesSnapshotsTestJSON-491867635 tempest-VolumesSnapshotsTestJSON-491867635-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f" status: 404 len: 109 microversion: 2.1 time: 0.038526 Aug 31 04:45:20.892190 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 597/1154] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:20 2022] GET /compute/v2.1/os-volumes/6791383b-1554-401a-8a55-db0a7039ef0f => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:21.821853 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:21.822467 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:21.829500 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:21.829989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:21.830429 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:21.831363 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:21.831814 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:21.832236 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:21.966572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:21.975299 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-789e22c0-57b2-4455-915d-026894dc09e9 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1576 microversion: 2.1 time: 0.157863 Aug 31 04:45:21.975877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 558/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:21 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:22.999739 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:23.000321 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:23.014494 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:23.015293 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:23.015992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:23.017099 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:23.017770 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:23.018463 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:23.154760 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:23.162682 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-91ce300b-2be7-4a0a-a442-49b5a38c9997 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1563 microversion: 2.1 time: 0.168890 Aug 31 04:45:23.163274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 598/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:22 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:23.583574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-91980b2e-fa2a-41ec-b5d2-879c6d380d3b req-85e92488-bdc6-4cb3-84a7-3ee72b50712c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3339d1f4-1f06-4585-aba3-ed352579d75a", "name": "network-vif-plugged", "status": "completed", "tag": "ae65d506-d89f-4468-a25b-cf6f8e85f73e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:23.595289 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-91980b2e-fa2a-41ec-b5d2-879c6d380d3b req-85e92488-bdc6-4cb3-84a7-3ee72b50712c service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:23.595762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-91980b2e-fa2a-41ec-b5d2-879c6d380d3b req-85e92488-bdc6-4cb3-84a7-3ee72b50712c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:23.596179 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-91980b2e-fa2a-41ec-b5d2-879c6d380d3b req-85e92488-bdc6-4cb3-84a7-3ee72b50712c service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:23.608302 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-91980b2e-fa2a-41ec-b5d2-879c6d380d3b req-85e92488-bdc6-4cb3-84a7-3ee72b50712c service nova] Creating event network-vif-plugged:ae65d506-d89f-4468-a25b-cf6f8e85f73e for instance 3339d1f4-1f06-4585-aba3-ed352579d75a on hv-cinder-85530 Aug 31 04:45:23.613574 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-91980b2e-fa2a-41ec-b5d2-879c6d380d3b req-85e92488-bdc6-4cb3-84a7-3ee72b50712c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Aug 31 04:45:23.614208 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 559/1157] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:23.823056 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ccf0fe74-e632-4894-9ae4-fb4c4e6f801d tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc82a8be1f0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:23.872487 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ccf0fe74-e632-4894-9ae4-fb4c4e6f801d tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/660fab45-81cf-4817-8427-526a25d426b6" status: 200 len: 351 microversion: 2.1 time: 0.053275 Aug 31 04:45:23.873048 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 599/1158] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:23 2022] GET /compute/v2.1/os-volumes/660fab45-81cf-4817-8427-526a25d426b6 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:25.222129 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-167d723a-fbaa-4340-b699-ebd5aba38c89 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc8270f8820>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:25.270839 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-167d723a-fbaa-4340-b699-ebd5aba38c89 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b9b1cc6f-032a-4a3e-8d44-06a85cd291ed" status: 200 len: 351 microversion: 2.1 time: 0.052864 Aug 31 04:45:25.271403 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 560/1159] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:25 2022] GET /compute/v2.1/os-volumes/b9b1cc6f-032a-4a3e-8d44-06a85cd291ed => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:26.663484 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7b8614c0-5f48-4ba8-952d-8aa18a41be34 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc8270e0a60>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:26.718134 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7b8614c0-5f48-4ba8-952d-8aa18a41be34 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dd9cdb5c-d4c9-4d36-891c-fdd3762e6228" status: 200 len: 350 microversion: 2.1 time: 0.059387 Aug 31 04:45:26.718865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 600/1160] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 31 04:45:26 2022] GET /compute/v2.1/os-volumes/dd9cdb5c-d4c9-4d36-891c-fdd3762e6228 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:26.732923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f225c910-f0f7-4e9f-9b43-7610523789ec tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc827067820>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:26.814030 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f225c910-f0f7-4e9f-9b43-7610523789ec tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086376 Aug 31 04:45:26.814598 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 561/1161] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 31 04:45:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:26.834499 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6b495151-57fd-4208-a53d-28d8dde32349 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc8270e0430>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:26.924865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6b495151-57fd-4208-a53d-28d8dde32349 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096213 Aug 31 04:45:26.925661 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 601/1162] 10.222.0.42 () {58 vars in 1149 bytes} [Wed Aug 31 04:45:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:26.943892 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-34eba103-b29c-4c08-b24d-95b3a15609fe tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc827067310>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:27.036988 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-34eba103-b29c-4c08-b24d-95b3a15609fe tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096880 Aug 31 04:45:27.037562 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 562/1163] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 31 04:45:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:27.051664 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-a6e5150d-868b-46fa-bddc-a4663c24119a tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc82a8bec10>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:27.139364 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-a6e5150d-868b-46fa-bddc-a4663c24119a tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091447 Aug 31 04:45:27.139934 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 602/1164] 10.222.0.42 () {58 vars in 1167 bytes} [Wed Aug 31 04:45:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:27.153448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-29936e31-e973-4d08-a4be-5fae907aacd3 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc8270f8820>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:27.240245 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-29936e31-e973-4d08-a4be-5fae907aacd3 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090350 Aug 31 04:45:27.241008 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 563/1165] 10.222.0.42 () {58 vars in 1170 bytes} [Wed Aug 31 04:45:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:27.256005 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1a267d1a-3e34-449a-8e3b-f12d02f21619 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc827122c10>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:27.336823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1a267d1a-3e34-449a-8e3b-f12d02f21619 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084532 Aug 31 04:45:27.337392 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 603/1166] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 31 04:45:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:27.350423 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f82d7027-41ab-402e-bc31-b42a8051cc21 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc8272a9790>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:27.435750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f82d7027-41ab-402e-bc31-b42a8051cc21 tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088987 Aug 31 04:45:27.436338 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 564/1167] 10.222.0.42 () {58 vars in 1188 bytes} [Wed Aug 31 04:45:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:27.449890 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e06e218e-82ee-444a-bedf-c5ed91e20cdc tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] Calling method '.version_select at 0x7fc827062a60>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:27.535000 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e06e218e-82ee-444a-bedf-c5ed91e20cdc tempest-VolumesTestJSON-819167777 tempest-VolumesTestJSON-819167777-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088509 Aug 31 04:45:27.535874 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 604/1168] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 31 04:45:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:53.752137 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=7 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:53.752895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=46 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:53.759135 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-566560114", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1950589606", "security_groups": [{"name": "tempest-secgroup-smoke-2075500102"}], "block_device_mapping_v2": [{"uuid": "e4bdb1ee-f024-4c07-a11c-9ed23fd93cc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c418a9e6-611c-4446-9f40-8356037355dc"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:53.876643 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] validate_networks() for [('c418a9e6-611c-4446-9f40-8356037355dc', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:45:54.379540 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:45:54.379984 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:45:54.380448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:45:54.380843 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:45:54.381239 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:45:54.390250 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:54.390740 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:54.391184 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:54.391924 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:54.392391 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:54.392799 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:54.410280 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:45:54.414259 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Getting quotas for user c11d44667e8e4db5bccccaee16d89a51 and project 312b9335479c4d72b78a20bb2f1b7296. Resources: {'cores', 'instances', 'ram'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:45:54.476936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:45:54.479527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4bdb1ee-f024-4c07-a11c-9ed23fd93cc5',volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:45:54.614464 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cd1c3050-af44-415f-857f-0def940bf511 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.864477 Aug 31 04:45:54.615549 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 565/1169] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 31 04:45:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:45:54.624163 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=3 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:54.624935 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:54.641013 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-ce79c6f4-9471-4273-b3c5-c5a603a37592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:54.641774 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-ce79c6f4-9471-4273-b3c5-c5a603a37592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:54.731858 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-ce79c6f4-9471-4273-b3c5-c5a603a37592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:54.743082 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-ce79c6f4-9471-4273-b3c5-c5a603a37592 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1094 microversion: 2.1 time: 0.120536 Aug 31 04:45:54.750747 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 605/1170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:54 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:55.765170 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:55.765926 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:55.778080 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:55.778572 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:55.779218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:55.779920 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:55.780371 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:55.780805 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:55.873245 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:55.887883 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1b4b6ee3-fc8d-407a-88c5-89af921f83fe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1200 microversion: 2.1 time: 0.127441 Aug 31 04:45:55.888834 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 566/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:55 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1200 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:56.910488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:56.911185 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:56.921425 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:56.922030 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:56.922467 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:56.923200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:56.923642 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:56.924884 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:57.055925 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:57.065660 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f6212dd9-57ac-4fec-bf10-7f945a80f5a3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.158986 Aug 31 04:45:57.074522 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 606/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:56 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:57.494411 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-70e8e0f9-67e2-4aae-a4b4-de8437f1b631 req-f2824d3e-d565-404c-8c85-3386e8d74b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d96391-a722-4906-bbd5-c7d961825895", "tag": "89058070-899b-4f0b-9c76-54c4138339c9"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:45:57.506695 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-70e8e0f9-67e2-4aae-a4b4-de8437f1b631 req-f2824d3e-d565-404c-8c85-3386e8d74b5e service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:57.507450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-70e8e0f9-67e2-4aae-a4b4-de8437f1b631 req-f2824d3e-d565-404c-8c85-3386e8d74b5e service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:57.507872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-70e8e0f9-67e2-4aae-a4b4-de8437f1b631 req-f2824d3e-d565-404c-8c85-3386e8d74b5e service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:57.520378 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-70e8e0f9-67e2-4aae-a4b4-de8437f1b631 req-f2824d3e-d565-404c-8c85-3386e8d74b5e service nova] Creating event network-changed:89058070-899b-4f0b-9c76-54c4138339c9 for instance e6d96391-a722-4906-bbd5-c7d961825895 on hv-cinder-85530 Aug 31 04:45:57.525279 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-70e8e0f9-67e2-4aae-a4b4-de8437f1b631 req-f2824d3e-d565-404c-8c85-3386e8d74b5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178125 Aug 31 04:45:57.526569 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 567/1173] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:45:58.088493 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:58.089233 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:58.095928 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:58.096401 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:58.096852 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:58.097534 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:58.097970 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:58.098379 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:58.251989 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:58.259479 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6eeb3403-0483-4e90-a924-909009753e29 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.175657 Aug 31 04:45:58.260668 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 607/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:58 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:45:59.281283 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:45:59.281975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:45:59.288195 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:59.288672 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:59.289091 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:59.290162 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:45:59.290604 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:45:59.291069 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:45:59.427881 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:45:59.436825 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dea535f7-de00-4efa-acb4-50ffe70c869b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.160342 Aug 31 04:45:59.437501 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 568/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:45:59 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:00.461732 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:00.462659 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:00.473488 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:00.474226 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:00.474992 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:00.476119 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:00.476850 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:00.477540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:00.611917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:00.624531 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-3711297d-623f-464d-b75c-4971c480319f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.169193 Aug 31 04:46:00.625274 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 608/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:00 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:01.651629 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:01.652372 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:01.660783 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:01.661370 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:01.661897 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:01.662762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:01.663334 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:01.663849 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:01.805264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:01.819050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d6826b18-7082-425f-9f5a-fb4937babae3 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.173189 Aug 31 04:46:01.819929 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 569/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:01 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:02.841237 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:02.841813 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:02.848326 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:02.848805 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:02.849224 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:02.849933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:02.850370 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:02.850812 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:03.000599 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:03.008625 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-6f123b0c-066b-4d97-9852-cb0cd15a91ca tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.171484 Aug 31 04:46:03.009801 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 609/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:02 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:04.211882 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:04.212886 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:04.219263 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:04.219778 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:04.220204 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:04.220889 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:04.221332 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:04.221750 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:04.368910 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:04.376877 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6608e906-33d3-4f7a-a07d-7eb5b3e2acc2 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.344160 Aug 31 04:46:04.377450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 570/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:04 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:05.403133 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:05.404031 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:05.407520 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell0:SELECT=2 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:05.416860 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:05.417629 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:05.418301 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:05.419386 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:05.420115 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:05.420861 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:05.582084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:05.590371 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-9200fc08-83e9-45a8-abfe-a6c01cb6de2b tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.193691 Aug 31 04:46:05.590987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 610/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:05 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:06.614525 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:06.615153 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:06.617589 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:06.618424 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:06.627919 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:06.628409 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:06.628929 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:06.629911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:06.630503 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:06.631180 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:06.765895 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:06.776788 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d07aff1f-9fe1-4423-a5e6-22beca7149d7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.168118 Aug 31 04:46:06.777365 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 571/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:06 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:07.801584 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:07.802554 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:07.814574 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:07.815427 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:07.816143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:07.817268 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:07.818114 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:07.818823 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:07.954295 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:07.962273 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-f3ea4f84-fc72-4eb0-b271-13af2ccf847e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.167138 Aug 31 04:46:07.962865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 611/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:07 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:08.987125 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:08.988087 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:08.996547 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:08.997022 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:08.997450 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:08.998133 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:08.998576 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:08.999019 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:09.143076 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:09.151218 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1bc0cd24-70ad-402d-b644-89acb156132a tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.170534 Aug 31 04:46:09.151781 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 572/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:08 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:10.171998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:10.172612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:10.179737 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:10.180213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:10.180650 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:10.181343 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:10.181785 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:10.182188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:10.321817 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:10.330129 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1a3097d4-9e66-4ecc-9394-82be06e857ea tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.161983 Aug 31 04:46:10.334753 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 612/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:10 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:10.592235 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-5a96d821-1a88-4877-a2c6-9779de2c6a8a req-c55e89d9-8c6f-406f-9852-2804cb716196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d96391-a722-4906-bbd5-c7d961825895", "name": "network-vif-plugged", "status": "completed", "tag": "89058070-899b-4f0b-9c76-54c4138339c9"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:46:10.602270 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5a96d821-1a88-4877-a2c6-9779de2c6a8a req-c55e89d9-8c6f-406f-9852-2804cb716196 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:10.602760 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5a96d821-1a88-4877-a2c6-9779de2c6a8a req-c55e89d9-8c6f-406f-9852-2804cb716196 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:10.603181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5a96d821-1a88-4877-a2c6-9779de2c6a8a req-c55e89d9-8c6f-406f-9852-2804cb716196 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:10.615561 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-5a96d821-1a88-4877-a2c6-9779de2c6a8a req-c55e89d9-8c6f-406f-9852-2804cb716196 service nova] Creating event network-vif-plugged:89058070-899b-4f0b-9c76-54c4138339c9 for instance e6d96391-a722-4906-bbd5-c7d961825895 on hv-cinder-85530 Aug 31 04:46:10.620975 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-5a96d821-1a88-4877-a2c6-9779de2c6a8a req-c55e89d9-8c6f-406f-9852-2804cb716196 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096547 Aug 31 04:46:10.621590 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 573/1185] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:46:11.351333 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:11.352045 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:11.359084 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:11.359669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:11.360205 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:11.360998 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:11.361524 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:11.362008 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:11.501146 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:11.511938 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-405f617c-2b9d-4acb-a289-c9390fd1fdb7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1266 microversion: 2.1 time: 0.164314 Aug 31 04:46:11.512612 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 613/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:11 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:12.536257 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:12.536874 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:12.543308 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:12.543936 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:12.544613 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:12.545913 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:12.546382 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:12.546842 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:12.692575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:12.703815 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b1fea0e-8490-4014-8707-ec60e15a20b0 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1453 microversion: 2.1 time: 0.172436 Aug 31 04:46:12.704374 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 574/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:12 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:12.727062 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:12.727669 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:12.735010 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:12.735496 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:12.735933 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:12.736624 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:12.737079 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:12.737501 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:12.872391 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:12.881768 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-d396cf48-a3e8-4e7e-a0e7-dfd2472d7d2e tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1453 microversion: 2.1 time: 0.158660 Aug 31 04:46:12.882340 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 614/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:12 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:14.821009 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-338c7af2-cc37-456e-b1d8-a1067d1b72c2 req-0a19f570-8850-4f9c-ae63-cfba99ba9ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d96391-a722-4906-bbd5-c7d961825895", "tag": "89058070-899b-4f0b-9c76-54c4138339c9"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:46:14.831266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-338c7af2-cc37-456e-b1d8-a1067d1b72c2 req-0a19f570-8850-4f9c-ae63-cfba99ba9ff8 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:14.831732 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-338c7af2-cc37-456e-b1d8-a1067d1b72c2 req-0a19f570-8850-4f9c-ae63-cfba99ba9ff8 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:14.832140 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-338c7af2-cc37-456e-b1d8-a1067d1b72c2 req-0a19f570-8850-4f9c-ae63-cfba99ba9ff8 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:14.843749 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-338c7af2-cc37-456e-b1d8-a1067d1b72c2 req-0a19f570-8850-4f9c-ae63-cfba99ba9ff8 service nova] Creating event network-changed:89058070-899b-4f0b-9c76-54c4138339c9 for instance e6d96391-a722-4906-bbd5-c7d961825895 on hv-cinder-85530 Aug 31 04:46:14.848842 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-338c7af2-cc37-456e-b1d8-a1067d1b72c2 req-0a19f570-8850-4f9c-ae63-cfba99ba9ff8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 Aug 31 04:46:14.849417 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 575/1189] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:46:45.135762 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:45.136420 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:45.137495 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:45.138793 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=50 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:45.141969 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=22 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:45.142610 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=54 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:45.144088 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:45.144962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:45.145600 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:45.146583 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:45.147755 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:45.148591 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:45.176459 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Going to try to terminate instance {{(pid=127197) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:46:45.266331 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0ff7c910-7f86-49cb-aea6-7f26f8c63094 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 204 len: 0 microversion: 2.1 time: 0.134470 Aug 31 04:46:45.267359 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 615/1190] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:46:45 2022] DELETE /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:46:45.276430 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:45.277245 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:45.283841 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:45.284364 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:45.284776 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:45.285461 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:45.285876 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:45.286287 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:45.357627 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-611c70bd-dff6-469b-baa8-c9c84df10342 req-ad186c2d-7eda-4cb4-a529-9a603fed71d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3339d1f4-1f06-4585-aba3-ed352579d75a", "tag": "ae65d506-d89f-4468-a25b-cf6f8e85f73e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:46:45.367582 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-611c70bd-dff6-469b-baa8-c9c84df10342 req-ad186c2d-7eda-4cb4-a529-9a603fed71d3 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:45.368603 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-611c70bd-dff6-469b-baa8-c9c84df10342 req-ad186c2d-7eda-4cb4-a529-9a603fed71d3 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:45.369196 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-611c70bd-dff6-469b-baa8-c9c84df10342 req-ad186c2d-7eda-4cb4-a529-9a603fed71d3 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:45.380686 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-611c70bd-dff6-469b-baa8-c9c84df10342 req-ad186c2d-7eda-4cb4-a529-9a603fed71d3 service nova] Creating event network-changed:ae65d506-d89f-4468-a25b-cf6f8e85f73e for instance 3339d1f4-1f06-4585-aba3-ed352579d75a on hv-cinder-85530 Aug 31 04:46:45.386866 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-611c70bd-dff6-469b-baa8-c9c84df10342 req-ad186c2d-7eda-4cb4-a529-9a603fed71d3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252258 Aug 31 04:46:45.387722 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 576/1191] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:46:45.427433 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:45.435456 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-7ea2c9a4-28fa-4559-898e-bfc3fe528d66 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.163416 Aug 31 04:46:45.436101 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 616/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:45 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:46.458128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:46.458728 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:46.465446 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:46.465658 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:46.466028 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:46.466758 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:46.467211 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:46.467619 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:46.626437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:46.634632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c92a443d-bc91-4ef8-b9f5-52c8f8edda54 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1569 microversion: 2.1 time: 0.181446 Aug 31 04:46:46.635233 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 577/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:46 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:47.658957 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:47.660145 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:47.668690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:47.669173 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:47.669615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:47.670310 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:47.670756 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:47.671171 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:47.723094 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-4c7b2730-0bc7-4072-bae0-dd0e5dbf4778 req-21b662be-2666-4f4b-8c32-8cbe55d1e2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3339d1f4-1f06-4585-aba3-ed352579d75a", "name": "network-vif-deleted", "tag": "ae65d506-d89f-4468-a25b-cf6f8e85f73e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:46:47.735230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4c7b2730-0bc7-4072-bae0-dd0e5dbf4778 req-21b662be-2666-4f4b-8c32-8cbe55d1e2c1 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:47.735702 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4c7b2730-0bc7-4072-bae0-dd0e5dbf4778 req-21b662be-2666-4f4b-8c32-8cbe55d1e2c1 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:47.736264 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4c7b2730-0bc7-4072-bae0-dd0e5dbf4778 req-21b662be-2666-4f4b-8c32-8cbe55d1e2c1 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:47.749169 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e0524ede63477a9875487d155be25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69713aca5ac144f9bca8348430ab9c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:46:47.749989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-4c7b2730-0bc7-4072-bae0-dd0e5dbf4778 req-21b662be-2666-4f4b-8c32-8cbe55d1e2c1 service nova] Creating event network-vif-deleted:ae65d506-d89f-4468-a25b-cf6f8e85f73e for instance 3339d1f4-1f06-4585-aba3-ed352579d75a on hv-cinder-85530 Aug 31 04:46:47.756103 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-4c7b2730-0bc7-4072-bae0-dd0e5dbf4778 req-21b662be-2666-4f4b-8c32-8cbe55d1e2c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037409 Aug 31 04:46:47.757098 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 578/1194] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:46:47.762103 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-e84d0749-7435-4a8f-ad1f-b3fd53b5ab75 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 200 len: 1382 microversion: 2.1 time: 0.107504 Aug 31 04:46:47.762806 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 617/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:47 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 1382 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:46:48.784575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:48.785385 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] [instance: 3339d1f4-1f06-4585-aba3-ed352579d75a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:46:48.791879 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:48.792387 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:48.792900 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:48.793640 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:46:48.794086 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:46:48.794503 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:46:48.809911 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] HTTP exception thrown: Instance 3339d1f4-1f06-4585-aba3-ed352579d75a could not be found. Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Request method failure captured: Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a HTTP/1.1 Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuarv7DW2gMxanYmHRuYbSX0nLLI_VY1TRUUzBInxw9EZ6qqBdXW-O-X8q1QPDYPGP4pWxxWhUvibMcuv1VKxXNGsC83wU8zhL74vBjUP6BF_KqG7GWM6YwiBGz_WoNo8PrmEaU5ME2jW2AUb8o11yLeLnwWaFD5isoY24cqhgyLn-k Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 69713aca5ac144f9bca8348430ab9c75 Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestShelveInstance-1602186003 Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:46:48.811653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69713aca5ac144f9bca8348430ab9c75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69713aca5ac144f9bca8348430ab9c75", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69713aca5ac144f9bca8348430ab9c75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69713aca5ac144f9bca8348430ab9c75"}]}] Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestShelveInstance-1602186003 Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 69713aca5ac144f9bca8348430ab9c75 Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestShelveInstance-1602186003 Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-TestShelveInstance-1602186003-project Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: 81e0524ede63477a9875487d155be25e Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestShelveInstance-1602186003-project Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 3339d1f4-1f06-4585-aba3-ed352579d75a could not be found. Aug 31 04:46:48.813431 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '3339d1f4-1f06-4585-aba3-ed352579d75a'} Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3339d1f4-1f06-4585-aba3-ed352579d75a could not be found. Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:46:48.814513 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3339d1f4-1f06-4585-aba3-ed352579d75a could not be found. Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3339d1f4-1f06-4585-aba3-ed352579d75a could not be found. Aug 31 04:46:48.816230 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:46:48.817653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Returning 404 to user: Instance 3339d1f4-1f06-4585-aba3-ed352579d75a could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:46:48.817653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9997e144-3865-4b45-8e2e-642f17fe06cf tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a" status: 404 len: 111 microversion: 2.1 time: 0.033720 Aug 31 04:46:48.817653 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 579/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:46:48 2022] GET /compute/v2.1/servers/3339d1f4-1f06-4585-aba3-ed352579d75a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:46:48.981698 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-68c62467-ee7b-45af-9f77-0f661b2e1114 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] Calling method '.version_select at 0x7fc8270a9dc0>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:46:49.007706 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-68c62467-ee7b-45af-9f77-0f661b2e1114 tempest-TestShelveInstance-1602186003 tempest-TestShelveInstance-1602186003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1722327674" status: 202 len: 0 microversion: 2.1 time: 0.029790 Aug 31 04:46:49.008293 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 618/1197] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Aug 31 04:46:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1722327674 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:47:54.835752 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:54.836571 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=12 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:54.838168 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:47:54.838310 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Wed Aug 31 04:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 (ip 10.222.0.42) !!! Aug 31 04:47:54.838815 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:54.841863 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG dbcounter [-] [127197] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:54.843428 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:47:54.843729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 04:47:54.844024 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:47:54.851509 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-b89b2813-2d52-41ee-aa6c-3d9b61be716e req-f2a0415f-d16f-40cc-b29b-d142d45f1443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d96391-a722-4906-bbd5-c7d961825895", "tag": "89058070-899b-4f0b-9c76-54c4138339c9"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:47:54.854404 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:54.855001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:54.855502 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:54.856258 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:54.856762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:54.857246 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:54.868398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-b89b2813-2d52-41ee-aa6c-3d9b61be716e req-f2a0415f-d16f-40cc-b29b-d142d45f1443 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:54.868982 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-b89b2813-2d52-41ee-aa6c-3d9b61be716e req-f2a0415f-d16f-40cc-b29b-d142d45f1443 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:54.869534 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-b89b2813-2d52-41ee-aa6c-3d9b61be716e req-f2a0415f-d16f-40cc-b29b-d142d45f1443 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:54.881816 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-b89b2813-2d52-41ee-aa6c-3d9b61be716e req-f2a0415f-d16f-40cc-b29b-d142d45f1443 service nova] Creating event network-changed:89058070-899b-4f0b-9c76-54c4138339c9 for instance e6d96391-a722-4906-bbd5-c7d961825895 on hv-cinder-85530 Aug 31 04:47:54.886041 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:47:54.887094 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-b89b2813-2d52-41ee-aa6c-3d9b61be716e req-f2a0415f-d16f-40cc-b29b-d142d45f1443 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050682 Aug 31 04:47:54.887917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 619/1198] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:47:54.975448 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4cbabe17-17f8-4f86-a1f2-48713ad3e1f7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 204 len: 0 microversion: 2.1 time: 0.141477 Aug 31 04:47:54.975981 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 580/1199] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:47:54 2022] DELETE /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:47:54.985012 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:47:54.985703 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:47:54.991983 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:54.992525 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:54.993034 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:54.993780 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:54.994284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:54.994782 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:55.137917 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:47:55.146104 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-4c0b5e9a-563e-4f87-a7af-7b6673e4dfcf tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1578 microversion: 2.1 time: 0.165196 Aug 31 04:47:55.146962 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 620/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:47:54 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:47:56.169274 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:47:56.169964 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:47:56.176746 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:56.177202 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:56.177632 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:56.178321 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:56.178872 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:56.179306 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:56.324862 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:47:56.332999 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7e527505-c78c-4050-9639-c86f69cca365 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1578 microversion: 2.1 time: 0.168200 Aug 31 04:47:56.333569 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 581/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:47:56 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:47:57.308192 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-d13dda8a-013c-4ec7-ba41-f388950e4fcb req-06aec1b1-1a81-4024-89eb-c20cf2320cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d96391-a722-4906-bbd5-c7d961825895", "name": "network-vif-deleted", "tag": "89058070-899b-4f0b-9c76-54c4138339c9"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:47:57.318398 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-d13dda8a-013c-4ec7-ba41-f388950e4fcb req-06aec1b1-1a81-4024-89eb-c20cf2320cc2 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:57.318899 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-d13dda8a-013c-4ec7-ba41-f388950e4fcb req-06aec1b1-1a81-4024-89eb-c20cf2320cc2 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:57.319350 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-d13dda8a-013c-4ec7-ba41-f388950e4fcb req-06aec1b1-1a81-4024-89eb-c20cf2320cc2 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:57.330540 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-d13dda8a-013c-4ec7-ba41-f388950e4fcb req-06aec1b1-1a81-4024-89eb-c20cf2320cc2 service nova] Creating event network-vif-deleted:89058070-899b-4f0b-9c76-54c4138339c9 for instance e6d96391-a722-4906-bbd5-c7d961825895 on hv-cinder-85530 Aug 31 04:47:57.335666 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-d13dda8a-013c-4ec7-ba41-f388950e4fcb req-06aec1b1-1a81-4024-89eb-c20cf2320cc2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031089 Aug 31 04:47:57.336429 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 621/1202] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:47:57.353951 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:47:57.354545 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:47:57.361928 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:57.362410 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:57.362859 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:57.363558 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:57.363989 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:57.364405 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:57.428965 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:47:57.437128 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3171bdb5-bc35-44a0-946f-525178c43c0f tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 200 len: 1225 microversion: 2.1 time: 0.087584 Aug 31 04:47:57.437736 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 582/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:47:57 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:47:58.463559 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:47:58.464266 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: e6d96391-a722-4906-bbd5-c7d961825895] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:47:58.473690 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:58.474254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:58.474859 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:58.476281 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:47:58.476742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:47:58.477165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:47:58.491726 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] HTTP exception thrown: Instance e6d96391-a722-4906-bbd5-c7d961825895 could not be found. Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Request method failure captured: Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 HTTP/1.1 Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZaBFypaa50UzmiZrqmAQxa2X9-cBZjitMtwFruzv98yWp4Q7d3BXh9SMeRxY6CexQ_tyUHDq_K5nu0kTEkDlYhoG-YaoATa47VrF_O_UnIj23bhfE4_vRBmmLavP8GeUWx5cIBtZfUb8cBBYdKzzS4ZFdyMqZZcbs-hAYH-z4uRbM Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:47:58.493383 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_312b9335479c4d72b78a20bb2f1b7296", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}] Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-TestVolumeBootPattern-786249260 Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: c11d44667e8e4db5bccccaee16d89a51 Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance e6d96391-a722-4906-bbd5-c7d961825895 could not be found. Aug 31 04:47:58.495143 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': 'e6d96391-a722-4906-bbd5-c7d961825895'} Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d96391-a722-4906-bbd5-c7d961825895 could not be found. Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:47:58.496200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d96391-a722-4906-bbd5-c7d961825895 could not be found. Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d96391-a722-4906-bbd5-c7d961825895 could not be found. Aug 31 04:47:58.497886 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:47:58.499375 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Returning 404 to user: Instance e6d96391-a722-4906-bbd5-c7d961825895 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:47:58.499375 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-1d5d6b3f-87f3-4b68-82b5-995ded3a7b13 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895" status: 404 len: 111 microversion: 2.1 time: 0.039889 Aug 31 04:47:58.499375 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 622/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:47:58 2022] GET /compute/v2.1/servers/e6d96391-a722-4906-bbd5-c7d961825895 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:48:01.896547 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:01.897638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:48:01.898374 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [req-02f9f0de-b6ff-42ba-8c95-70edb170737c req-a1eabd1a-1893-49ae-8acc-5b875a5848de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31", "tag": "7bad20dd-2756-4449-9691-6e79374ebc0c"}]} {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:48:01.904422 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:01.905143 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:01.905575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:01.906276 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:01.906745 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:01.907181 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:01.909729 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-02f9f0de-b6ff-42ba-8c95-70edb170737c req-a1eabd1a-1893-49ae-8acc-5b875a5848de service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:01.910267 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-02f9f0de-b6ff-42ba-8c95-70edb170737c req-a1eabd1a-1893-49ae-8acc-5b875a5848de service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:01.911150 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [req-02f9f0de-b6ff-42ba-8c95-70edb170737c req-a1eabd1a-1893-49ae-8acc-5b875a5848de service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:01.924289 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.compute.server_external_events [req-02f9f0de-b6ff-42ba-8c95-70edb170737c req-a1eabd1a-1893-49ae-8acc-5b875a5848de service nova] Creating event network-changed:7bad20dd-2756-4449-9691-6e79374ebc0c for instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 on hv-cinder-85530 Aug 31 04:48:01.930447 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [req-02f9f0de-b6ff-42ba-8c95-70edb170737c req-a1eabd1a-1893-49ae-8acc-5b875a5848de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035520 Aug 31 04:48:01.933832 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 623/1205] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:48:01.935041 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:48:02.028575 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5e99efc3-92f5-4c17-94ed-3f0e67dfab62 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "DELETE /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 204 len: 0 microversion: 2.1 time: 0.135618 Aug 31 04:48:02.032674 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 583/1206] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:48:01 2022] DELETE /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:48:02.038742 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:02.039492 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:48:02.051574 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:02.052165 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:02.052809 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:02.053511 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:02.054136 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:02.054568 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:02.206127 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:48:02.214844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-549f6a25-8a5c-453c-9d4c-9c5c27541bf7 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1577 microversion: 2.1 time: 0.180632 Aug 31 04:48:02.215655 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 624/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:48:02 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:48:03.237536 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:03.238223 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:48:03.247114 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:03.247648 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:03.248226 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:03.249053 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:03.249827 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:03.250408 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:03.394235 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:48:03.403018 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5601231c-95dd-4fdd-a24d-153238fc075c tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1577 microversion: 2.1 time: 0.169807 Aug 31 04:48:03.403581 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 584/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:48:03 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:48:04.424864 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:04.425465 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:48:04.432618 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:04.433092 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:04.433510 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:04.434200 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:04.434645 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:04.435077 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:04.593001 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.policy [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d44667e8e4db5bccccaee16d89a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b9335479c4d72b78a20bb2f1b7296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127197) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:48:04.595631 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-4ea09d25-4e9e-462c-bd79-8e84ab014172 req-5498dcc6-12b6-4bc4-9d3d-00d0fb7fc196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31", "name": "network-vif-deleted", "tag": "7bad20dd-2756-4449-9691-6e79374ebc0c"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:48:04.604279 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-0ed1eaac-688b-4645-8136-3db75d4a10c6 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 200 len: 1459 microversion: 2.1 time: 0.183286 Aug 31 04:48:04.604972 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 625/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:48:04 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 1459 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:48:04.606817 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4ea09d25-4e9e-462c-bd79-8e84ab014172 req-5498dcc6-12b6-4bc4-9d3d-00d0fb7fc196 service nova] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:04.607291 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4ea09d25-4e9e-462c-bd79-8e84ab014172 req-5498dcc6-12b6-4bc4-9d3d-00d0fb7fc196 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:04.607716 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4ea09d25-4e9e-462c-bd79-8e84ab014172 req-5498dcc6-12b6-4bc4-9d3d-00d0fb7fc196 service nova] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:04.620012 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-4ea09d25-4e9e-462c-bd79-8e84ab014172 req-5498dcc6-12b6-4bc4-9d3d-00d0fb7fc196 service nova] Creating event network-vif-deleted:7bad20dd-2756-4449-9691-6e79374ebc0c for instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 on hv-cinder-85530 Aug 31 04:48:04.624856 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-4ea09d25-4e9e-462c-bd79-8e84ab014172 req-5498dcc6-12b6-4bc4-9d3d-00d0fb7fc196 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Aug 31 04:48:04.625453 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 585/1210] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 31 04:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:48:05.627317 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:05.628098 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:48:05.637587 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:05.638213 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:05.638837 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:05.639705 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:05.640294 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:05.640844 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:05.656580 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] HTTP exception thrown: Instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 could not be found. Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Request method failure captured: Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 HTTP/1.1 Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZaBFypaa50UzmiZrqmAQxa2X9-cBZjitMtwFruzv98yWp4Q7d3BXh9SMeRxY6CexQ_tyUHDq_K5nu0kTEkDlYhoG-YaoATa47VrF_O_UnIj23bhfE4_vRBmmLavP8GeUWx5cIBtZfUb8cBBYdKzzS4ZFdyMqZZcbs-hAYH-z4uRbM Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:48:05.658254 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_312b9335479c4d72b78a20bb2f1b7296", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}] Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: c11d44667e8e4db5bccccaee16d89a51 Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 could not be found. Aug 31 04:48:05.659865 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31'} Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 could not be found. Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:48:05.661066 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 could not be found. Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 could not be found. Aug 31 04:48:05.662615 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:05.664284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Returning 404 to user: Instance 39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:48:05.664284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-b9a9ae0f-a9aa-4e44-94ef-13e69fa30675 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31" status: 404 len: 111 microversion: 2.1 time: 0.037693 Aug 31 04:48:05.664284 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 626/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:48:05 2022] GET /compute/v2.1/servers/39e7e2ee-3cb0-46ef-92df-8e5e6e9e8d31 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:48:06.115947 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:06.116527 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:48:06.126535 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:06.127434 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:06.128150 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:06.129266 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:06.130001 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:06.130762 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:06.145714 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] HTTP exception thrown: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Request method failure captured: Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d HTTP/1.1 Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept: application/json Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Connection: close Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Length: 0 Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Content-Type: application/json Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Host: 10.222.0.42 Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjDuZaBFypaa50UzmiZrqmAQxa2X9-cBZjitMtwFruzv98yWp4Q7d3BXh9SMeRxY6CexQ_tyUHDq_K5nu0kTEkDlYhoG-YaoATa47VrF_O_UnIj23bhfE4_vRBmmLavP8GeUWx5cIBtZfUb8cBBYdKzzS4ZFdyMqZZcbs-hAYH-z4uRbM Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Role: reader,member Aug 31 04:48:06.147381 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Roles: reader,member Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_312b9335479c4d72b78a20bb2f1b7296", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}] Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Id: c11d44667e8e4db5bccccaee16d89a51 Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: method: > Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: exception: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.149361 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: action_args: {'id': '1083f879-d1a1-4430-8b82-35a8833d029d'} Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:48:06.150437 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.152050 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.153923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Returning 404 to user: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:48:06.153923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1eefd216-7f67-4c49-825b-78689fd93ffe tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 404 len: 111 microversion: 2.1 time: 0.040762 Aug 31 04:48:06.153923 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 586/1212] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 31 04:48:06 2022] DELETE /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:48:06.159786 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '>' {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:06.161125 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.compute.api [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] [instance: 1083f879-d1a1-4430-8b82-35a8833d029d] Fetching instance by UUID {{(pid=127197) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:48:06.168693 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:06.169164 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:06.169630 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:06.170314 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Acquiring lock "04318292-e935-4b51-a3d6-6ee7b9045164" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:48:06.170757 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:48:06.171188 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG oslo_concurrency.lockutils [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Lock "04318292-e935-4b51-a3d6-6ee7b9045164" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:48:06.186400 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.wsgi [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] HTTP exception thrown: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Request method failure captured: Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: request: GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d HTTP/1.1 Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept: application/json Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Accept-Encoding: identity Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Connection: close Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Length: 0 Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Content-Type: application/json Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Host: 10.222.0.42 Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: Openstack-System-Scope: None Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: User-Agent: python-urllib3/1.26.12 Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Auth-Token: gAAAAABjDuZaBFypaa50UzmiZrqmAQxa2X9-cBZjitMtwFruzv98yWp4Q7d3BXh9SMeRxY6CexQ_tyUHDq_K5nu0kTEkDlYhoG-YaoATa47VrF_O_UnIj23bhfE4_vRBmmLavP8GeUWx5cIBtZfUb8cBBYdKzzS4ZFdyMqZZcbs-hAYH-z4uRbM Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Id: None Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Domain-Name: None Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Identity-Status: Confirmed Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Is-Admin-Project: True Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Id: default Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Domain-Name: Default Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Project-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Role: reader,member Aug 31 04:48:06.187987 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Roles: reader,member Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_312b9335479c4d72b78a20bb2f1b7296", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/312b9335479c4d72b78a20bb2f1b7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/312b9335479c4d72b78a20bb2f1b7296"}]}] Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Id: 312b9335479c4d72b78a20bb2f1b7296 Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-Tenant-Name: tempest-TestVolumeBootPattern-786249260 Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Id: default Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Domain-Name: Default Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Id: c11d44667e8e4db5bccccaee16d89a51 Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: X-User-Name: tempest-TestVolumeBootPattern-786249260-project Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: method: > Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: exception: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.189620 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: action_args: {'id': '1083f879-d1a1-4430-8b82-35a8833d029d'} Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: {{(pid=127197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:48:06.190555 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. Aug 31 04:48:06.192130 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: ERROR nova.api.openstack.wsgi Aug 31 04:48:06.193495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: DEBUG nova.api.openstack.wsgi [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Returning 404 to user: Instance 1083f879-d1a1-4430-8b82-35a8833d029d could not be found. {{(pid=127197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:48:06.193495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: INFO nova.api.openstack.requestlog [None req-2088b588-da48-4812-af6a-15826e4e11fb tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d" status: 404 len: 111 microversion: 2.1 time: 0.035597 Aug 31 04:48:06.193495 dv-cinder-855307-1-iscsi devstack@n-api.service[127197]: [pid: 127197|app: 0|req: 627/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 31 04:48:06 2022] GET /compute/v2.1/servers/1083f879-d1a1-4430-8b82-35a8833d029d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:48:07.502638 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-243142c4-ae08-4fc6-8c8d-8d3219334b47 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] Calling method '.version_select at 0x7fc82708a040>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:48:07.527894 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-243142c4-ae08-4fc6-8c8d-8d3219334b47 tempest-TestVolumeBootPattern-786249260 tempest-TestVolumeBootPattern-786249260-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1950589606" status: 202 len: 0 microversion: 2.1 time: 0.029120 Aug 31 04:48:07.528617 dv-cinder-855307-1-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 587/1214] 10.222.0.42 () {58 vars in 1263 bytes} [Wed Aug 31 04:48:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1950589606 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)